What you'll learn

Understand the fundamentals of Web Scraping
Understand Scrapy Architecture
Scrape websites using Scrapy
Understand Xpath
Extract and locate nodes from the DOM using XPath
Build a complete Spider from A to Z
Deploy Spiders to the cloud
Store the extracted Data in MongoDb
Understand how Splash Works
Scrape websites that relies on jаvascript to render their content using Scrapy-Splash
Build a CrawlSpider
Understand the Crawling behavior
Build a custom Middleware
Web Scraping best practices
Avoid getting banned while scraping websites
Scrape APIs
Scrape infinite scroll websites
Working with Cookies
Deploy spiders locally
Deploy spiders to Heroku
Run spiders periodically
Prevent storing duplicated data
Deploy Splash to Heroku
Write Data to Excel files
Login to websites using Scrapy
Download images and files using Scrapy
Use Crawlera with Scrapy
Add proxies to the CrawlSpider
Free proxies with Scrapy

Requirements
Basics of Python
Basics of HTML
Basics of jаvascript
Internet access

Who this course is for?
Anyone who wants to scrape data from any website
Anyone who wants to learn Scrapy
Anyone who wants to automate the task of copying contents from websites
Anyone who wants to learn how to scrape jаvascript websites using Scrapy-Splash
Anyone who wants to learn the basics of Xpath
Anyone who want to learn Scrapy Splash
[/i]Homepage
https://www.udemy.com/web-scraping-in-python-using-scrapy-and-splash/
[i]Screenshots