Apify

Apify and Crawlee Official Forum

Updated 10 months ago

Is there a gentle way to run a crawler for x minutes?

SStrijdhagen
·
I understand there's a way to stop crawling after x number of requests with maxRequestsPerCrawl
S
O
3 comments
SStrijdhagen
Is there a gentle way to run a crawler for x minutes?
OOleg V.
You can set any timeout you want.
More info here:
https://docs.apify.com/platform/actors/running/input-and-output#options---build-timeout-and-memory
SStrijdhagen
Thanks Oleg but I'm not using Apify, I'm running crawlee.dev locally.
Add a reply
Sign up and join the conversation on Discord