Apify and Crawlee Official Forum

Home
Members
titavilanova2
t
titavilanova2
Offline, last seen 2 weeks ago
Joined January 3, 2025
Hey everyone. :perfecto: :crawlee:
Currently, I am working on scraping one website where new content (pages) is added frequently (as an example we can say like a blog). So when I run my scraper it scrapes all pages successfully but when I run it for example tomorrow (when new pages are added to websites) it will start scraping everything again.

I would be thankful if you could give me some advice, ideas, solutions, or examples out there of efficiently re-scraping without crawling the entire site again.

Thank you in advance. 🙏🏻
3 comments
m
a