University of Michigan - Ann Arbor

Scrapy is a Python framework that is used to create web crawlers. These web crawlers can extract structured data directly from web sites or by using APIs. 

Scrapy

To install Scrapy using pip, type the following into your terminal:
```bash
$ pip install scrapy
```

Installing Scrapy

https://docs.scrapy.org/en/latest/intro/tutorial.html

Scrapy Tutorial

Spiders are custom classes that determine how your web crawler will scrape information. They are accessed with scrapy.spiders.Spider

Learn Before

Related

Related