Apify and Crawlee Official Forum

Updated 3 months ago

PuppeteerCrawler sometimes hangs and waiting for time out

I have created an actor on Apify platform with PuppeteerCrawler and when im running over 1.5k runs some of them (like 30-40) are hanging on INFO PuppeteerCrawler: Starting the crawler step. Nothing is happening, just actor is waiting for the timeout.
It is happening only for 30 runs of 1.5k, so Im not sure if its actor issue.
Do you know what reason it could be?
Attachment
image.png
P
1 comment
Hi @kd_wmc I would say it can depend on the website that you are scraping. I would try to put some logging into the `prenavigation hook! and check where the issue is, I could be just the website got stuck when loading.
Add a reply
Sign up and join the conversation on Discord