html5lib：TypeError：__init __（）得到了意想不到的关键字参数'encoding'

Question

我试图安装html5lib。起初我试图安装最新版本（8或9个9），但它与我的BeautifulSoup发生冲突，所以我决定尝试旧的版本（0.9999999,seven nines）。我安装了它，但是当我尝试使用它：

>>> with urlopen("http://example.com/") as f: 
    document = html5lib.parse(f, encoding=f.info().get_content_charset()) 

我得到一个错误：

Traceback (most recent call last): 
    File "<pyshell#11>", line 2, in <module> 
    document = html5lib.parse(f, encoding=f.info().get_content_charset()) 
    File "C:\Python\Python35-32\lib\site-packages\html5lib\html5parser.py", line 35, in parse 
    return p.parse(doc, **kwargs) 
    File "C:\Python\Python35-32\lib\site-packages\html5lib\html5parser.py", line 235, in parse 
    self._parse(stream, False, None, *args, **kwargs) 
    File "C:\Python\Python35-32\lib\site-packages\html5lib\html5parser.py", line 85, in _parse 
    self.tokenizer = _tokenizer.HTMLTokenizer(stream, parser=self, **kwargs) 
    File "C:\Python\Python35-32\lib\site-packages\html5lib\_tokenizer.py", line 36, in __init__ 
    self.stream = HTMLInputStream(stream, **kwargs) 
    File "C:\Python\Python35-32\lib\site-packages\html5lib\_inputstream.py", line 151, in HTMLInputStream 
    return HTMLBinaryInputStream(source, **kwargs) 
TypeError: __init__() got an unexpected keyword argument 'encoding' 

什么是错的，我该怎么办？

Answer 1

我看到一些在html5lib的最新版本打破了关于BS4，html5lib.treebuilders._base不再存在，USNG BS4 4.4.1最新的兼容版本似乎是一个有7个花枝招展，一旦你安装它，如下正常工作：

pip3 install -U html5lib=="0.9999999" 

使用BS4 4.4.1测试：

In [1]: import bs4 

In [2]: bs4.__version__ 
Out[2]: '4.4.1' 

In [3]: import html5lib 

In [4]: html5lib.__version__ 
Out[4]: '0.9999999' 

In [5]: from urllib.request import urlopen 

In [6]: with urlopen("http://example.com/") as f: 
    ...:   document = html5lib.parse(f, encoding=f.info().get_content_charset()) 
    ...:  

In [7]: 

你可以看到在这个变化提交Rename treebuilders._base to .base to reflect public status名称改为：

您所看到的错误是因为你还在使用最新版本，在html5lib/_inputstream.py，HTMLBinaryInputStream没有编码ARG：

class HTMLBinaryInputStream(HTMLUnicodeInputStream): 
    """Provides a unicode stream of characters to the HTMLTokenizer. 

    This class takes care of character encoding and removing or replacing 
    incorrect byte-sequences and also provides column and line tracking. 

    """ 

    def __init__(self, source, override_encoding=None, transport_encoding=None, 
       same_origin_parent_encoding=None, likely_encoding=None, 
       default_encoding="windows-1252", useChardet=True): 

设置override_encoding = f.info（） .get_content_charset（）应该这样做。

也升级到BS4的最新版本的正常工作与最新版本html5lib的：

In [16]: bs4.__version__ 
Out[16]: '4.5.1' 

In [17]: html5lib.__version__ 
Out[17]: '0.999999999' 

In [18]: with urlopen("http://example.com/") as f: 
      document = html5lib.parse(f, override_encoding=f.info().get_content_charset()) 
    ....:  

In [19]: