SUMMARY: The purpose of this projectis to practice web scraping by extracting specific pieces of information from awebsite. The web scraping code was written in Python 3 and leveraged the Scrapy framework maintained by Scrapinghub.
INTRODUCTION: Daines Analytics hosts its blog at dainesanalytics.blog. The purpose of this exercise is to practice web scraping using Scrapy by gathering the blog entries from Daines Analytics’ RSS feed. This iteration of the script automatically traverses the RSS feed to capture all blog entries, not just the first ten as in Take1.
Starting URLs: https://dainesanalytics.blog/feed/
The source code and JSON output can be found here on GitHub.