I'm looking to create an automated solution involving the web scraping of dynamic sources and URLs. I've got a few automation tools in mind that can help me bridge the gap between technologies such as Zapier.
Currently, I am able to identify dynamic changes to a web page and if a change is made such as adding a new article, an output of the articles URL will be placed in a google sheet.
Now I'd like to take this further. I'd like to somehow automate it so that once a new row is added to the spreadsheet (which means a new article title and its associated link are added in neighboring columns), I then have a bot visit that link and print to PDF and save to some local or cloud based directory.
If anyone has experience with the PDF portion and using apify/crawlee for this I'd love some pointers. I think this platform is sick and I'd be able to accomplish a lot. I can't wait to see how far I can take this.
