Getting Structured Data from the Internet: Running Web Crawlers/Scrapers on a Big Data Production Scale 1st ed. Edition

This was a great resource to understand web crawling on scale using AWS using common crawl data. I would recommend it.

There is useful information, and code in this book, but the usefulness is limited because it only works on the sample sites, and there is no talk about how to debug or problem-solve.Basically the code works only on the sample sites provided, which makes this an expensive 'all you have to do is' tutorial build over sample data that does not apply to the real world.

The author gives a step-wise guideline with examples for people who wants to start on web scraping

This text is an excellent resource for anyone interested in web scraping.