Windows7 Python3 搭建Scrapy 爬虫框架
Windows7(64位) Python3.7 安装Scrapy 提示如下错误信息:
解决办法:
1.在python库中下载twisted相应的包(.whl文件)
官网地址:https://www.lfd.uci.edu/~gohlke/pythonlibs/
2、python 通过pip 安装本地whl 软件包。
d:\whl>pip install wheel #pip 安装whell
Collecting wheel
Downloading https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fb
e9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl
Installing collected packages: wheel
Successfully installed wheel-0.33.1
d:\whl>pip install D:\whl\Twisted-18.7.0-cp37-cp37m-win_amd64.whl #pip 本地安装**.whl软件
3、python 安装scrapy,并验证是否安装成功
d:\whl>pip install scrapy #安装scrapy 爬虫框架
d:\whl>scrapy #验证scrapy 爬虫框架是否安装成功
Scrapy 1.6.0 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command