Windows7 Python3 搭建Scrapy 爬虫框架

Windows7(64位) Python3.7 安装Scrapy 提示如下错误信息:

Windows7 Python3 搭建Scrapy 爬虫框架

解决办法:

1.在python库中下载twisted相应的包(.whl文件) 

官网地址:https://www.lfd.uci.edu/~gohlke/pythonlibs/

Windows7 Python3 搭建Scrapy 爬虫框架

2、python 通过pip 安装本地whl 软件包。

d:\whl>pip install wheel  #pip 安装whell
Collecting wheel
  Downloading https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fb
e9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl
Installing collected packages: wheel
Successfully installed wheel-0.33.1

d:\whl>pip install D:\whl\Twisted-18.7.0-cp37-cp37m-win_amd64.whl   #pip 本地安装**.whl软件

3、python 安装scrapy,并验证是否安装成功

d:\whl>pip install scrapy  #安装scrapy 爬虫框架
d:\whl>scrapy     #验证scrapy 爬虫框架是否安装成功
Scrapy 1.6.0 - no active project

Usage:
  scrapy <command> [options] [args]

Available commands:
  bench         Run quick benchmark test
  fetch         Fetch a URL using the Scrapy downloader
  genspider     Generate new spider using pre-defined templates
  runspider     Run a self-contained spider (without creating a project)
  settings      Get settings values
  shell         Interactive scraping console
  startproject  Create new project
  version       Print Scrapy version
  view          Open URL in browser, as seen by Scrapy

  [ more ]      More commands available when run from project directory

Use "scrapy <command> -h" to see more info about a command