Modern Web Scraping with Python using Scrapy Splash Selenium
Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash and Selenium 2nd EDITION (2021)
4.37 (3802 reviews)
25 314
students
9 hours
content
May 2021
last update
$79.99
regular price
What you will learn
Understand the fundamentals of Web Scraping
Scrape websites using Scrapy
Understand Xpath & CSS Selectors
Build a complete Spider from A to Z
Store the extracted Data in MongoDb & SQLite3
Scrape JavaScript websites using Splash & Selenium
Build a CrawlSpider
Understand the Crawling behavior
Build a custom Middleware
Web Scraping best practices
Avoid getting banned while scraping websites
Bypass cloudflare
Scrape APIs
Scrape infinite scroll websites
Working with Cookies
Deploy spiders locally and to the cloud
Run spiders periodically
Prevent storing duplicated data
Build datasets
Login to websites using Scrapy
Download images and files using Scrapy
Course Gallery
Charts
Students
Price
Rating & Reviews
Enrollment Distribution
Comidoc Review
Our Verdict
Modern Web Scraping with Python using Scrapy Splash Selenium offers an extensive exploration of various web scraping techniques and tools. The course is enriched with numerous practical projects that help students understand the nuances of creating Spiders, storing data in databases, bypassing clouds and avoiding website bans while scraping. However, there are concerns regarding outdated information in a few areas along with occasional lapses in clear explanations. Furthermore, the strong accent is mentioned as an obstacle for some learners. Acknowledging these drawbacks, this course remains valuable, especially for aspiring web scrapers who wish to grow their skillset using Scrapy, Splash and Selenium.
What We Liked
- In-depth coverage of web scraping techniques using various tools like Scrapy, Splash and Selenium
- Covers creating a complete Spider from scratch, handling duplicated data and storing extracted data in MongoDb & SQLite3
- Comprehensive projects to enhance understanding of web crawling and scraping concepts
- Valuable insights on best practices for web scraping and avoiding bans
Potential Drawbacks
- A few users have reported outdated content, non-functional links in projects and lack of instructor's responsiveness to queries
- Strong accent may hinder understanding the lessons leading to slower learning
- Incomplete or missing explanations for certain concepts, leaving students to figure out things on their own
- Quality control issues with transcriptions
Related Topics
1757906
udemy ID
20/06/2018
course created date
22/10/2019
course indexed date
Bot
course submited by