The premise of web scraping has always remained the same. You use a library like Selenium or Puppeteer to load up your target application and navigate

An Event-Driven Approach to Web Scraping

submited by
Style Pass
2021-09-13 19:30:10

The premise of web scraping has always remained the same. You use a library like Selenium or Puppeteer to load up your target application and navigate through them using hacky DOM queries and screen parsing. I have never written a scrape for an application that provided any real reusability. That’s where Krawlr comes in. Krawlr is an event driven web scraping library that breaks up scrapes into multiple reusable…

Leave a Comment