Matt Layman • 1/6/2024

Fun With Scrapy Link Validation on CI

Read Original

This technical article explains a method for automatically validating all internal links on a statically generated website. The author details a solution using Scrapy, a Python web scraping framework, to create a spider that crawls the site, combined with honcho to manage processes and GitHub Actions for Continuous Integration, ensuring broken links are caught automatically.

0 Comments
#continuous integration #web scraping #Scrapy
Fun With Scrapy Link Validation on CI

Comments

No comments yet

Be the first to share your thoughts!

Browser Extension

Get instant access to AllDevBlogs from your browser

Top of the Week

No top articles yet