read_html(io: 'FilePath | ReadBuffer[str]', match: 'str | Pattern' = '.+', flavor: 'str | None' = None, header: 'int | Sequence[int] | None' = None, index_col: 'int | Sequence[int] | None' = None, skiprows: 'int | Sequence[int] | slice | None' = None, attrs: 'dict[str, str] | None' = None, parse_dates: 'bool' = False, thousands: 'str | None' = ',', encoding: 'str | None' = None, decimal: 'str' = '.', converters: 'dict | None' = None, na_values=None, keep_default_na: 'bool' = True, displayed_only: 'bool' = True) -> 'list[DataFrame]'
Before using this function you should read the gotchas about the
HTML parsing libraries <io.html.gotchas>
.
Expect to do some cleanup after you call this function. For example, you might need to manually assign column names if the column names are converted to NaN when you pass the :None:None:`header=0` argument. We try to assume as little as possible about the structure of the table and push the idiosyncrasies of the HTML contained in the table to the user.
This function searches for <table>
elements and only for <tr>
and <th>
rows and <td>
elements within each <tr>
or <th>
element in the table. <td>
stands for "table data". This function attempts to properly handle colspan
and rowspan
attributes. If the function has a <thead>
argument, it is used to construct the header, otherwise the function attempts to find the header within the body (by putting rows with only <th>
elements into the header).
Similar to ~read_csv
the :None:None:`header` argument is applied after skiprows
is applied.
This function will always return a list of DataFrame
or it will fail, e.g., it will not return an empty list.
String, path object (implementing os.PathLike[str]
), or file-like object implementing a string read()
function. The string can represent a URL or the HTML itself. Note that lxml only accepts the http, ftp and file url protocols. If you have a URL that starts with 'https'
you might try removing the 's'
.
The set of tables containing text matching this regex or string will be returned. Unless the HTML is extremely simple you will probably need to pass a non-empty string here. Defaults to '.+' (match any non-empty string). The default value will return all tables contained on a page. This value is converted to a regular expression so that there is consistent behavior between Beautiful Soup and lxml.
The parsing engine to use. 'bs4' and 'html5lib' are synonymous with each other, they are both there for backwards compatibility. The default of None
tries to use lxml
to parse and if that fails it falls back on bs4
+ html5lib
.
The row (or list of rows for a ~pandas.MultiIndex
) to use to make the columns headers.
The column (or list of columns) to use to create the index.
Number of rows to skip after parsing the column integer. 0-based. If a sequence of integers or a slice is given, will skip the rows indexed by that sequence. Note that a single element sequence means 'skip the nth row' whereas an integer means 'skip n rows'.
This is a dictionary of attributes that you can pass to use to identify the table in the HTML. These are not checked for validity before being passed to lxml or Beautiful Soup. However, these attributes must be valid HTML table attributes to work correctly. For example, :
attrs = {'id': 'table'}
is a valid attribute dictionary because the 'id' HTML tag attribute is a valid HTML attribute for any HTML tag as per :None:None:`this document
<https://html.spec.whatwg.org/multipage/dom.html#global-attributes>`. :
attrs = {'asdf': 'table'}
is not a valid attribute dictionary because 'asdf' is not a valid HTML attribute even if it is a valid XML attribute. Valid HTML 4.01 table attributes can be found :None:None:`here
<http://www.w3.org/TR/REC-html40/struct/tables.html#h-11.2>`. A working draft of the HTML 5 spec can be found :None:None:`here
<https://html.spec.whatwg.org/multipage/tables.html>`. It contains the latest information on table attributes for the modern web.
See ~read_csv
for more details.
Separator to use to parse thousands. Defaults to ','
.
The encoding used to decode the web page. Defaults to None
.``None`` preserves the previous encoding behavior, which depends on the underlying parser library (e.g., the parser library will try to use the encoding provided by the document).
Character to recognize as decimal point (e.g. use ',' for European data).
Dict of functions for converting values in certain columns. Keys can either be integers or column labels, values are functions that take one input argument, the cell (not column) content, and return the transformed content.
Custom NA values.
If na_values are specified and keep_default_na is False the default NaN values are overridden, otherwise they're appended to.
Whether elements with "display: none" should be parsed.
A list of DataFrames.
Read HTML tables into a list
of DataFrame
objects.
read_csv
Read a comma-separated values (csv) file into DataFrame.
See the read_html documentation in the IO section of the docs
<io.read_html>
for some examples of reading in HTML tables.
The following pages refer to to this document either explicitly or contain code examples using this.
pandas.errors.ParserError
pandas.io.xml.read_xml
Hover to see nodes names; edges to Self not shown, Caped at 50 nodes.
Using a canvas is more power efficient and can get hundred of nodes ; but does not allow hyperlinks; , arrows or text (beyond on hover)
SVG is more flexible but power hungry; and does not scale well to 50 + nodes.
All aboves nodes referred to, (or are referred from) current nodes; Edges from Self to other have been omitted (or all nodes would be connected to the central node "self" which is not useful). Nodes are colored by the library they belong to, and scaled with the number of references pointing them