scrapy

Web-crawling framework. More information: https://scrapy.org.

scrapy startproject project_name

scrapy genspider spider_name website_domain

scrapy edit spider_name

scrapy crawl spider_name

scrapy fetch url

scrapy view url

scrapy shell url