Apify and Crawlee Official Forum

Updated 5 months ago

100 Page Limit on Content Crawler

At a glance
Running a content crawler from Stack-Ai and repeatedly scraping only 100 pages. I am just testing out the platform so I am using a trial. Is that the problem? Just tracking down what the problem is across the two apps.
L
T
C
5 comments
The actor normally has an input where you can configure this and other settings. Does the Stack AI integration allow setting it? It was not developer by Apify
The setting would be maximum pages right?
I am getting this message when attempting to scrape a website : "You've set memory lower than the minimum of 1024MB allowed for this Actor". My account was overcharged and the usage was depleted. However, my account was subsequently credited with the amount overcharged. But now my queries won't execute due to insufficient memory. Thanks for your help.
I'm not sure where on Stack AI you can configure memory but 1024 is minimum for this actor (so it has reasonable speed)
Add a reply
Sign up and join the conversation on Discord