Apify Discord Mirror

Updated 5 months ago

100 Page Limit on Content Crawler

At a glance

The community member is running a content crawler from Stack-AI and is repeatedly scraping only 100 pages while testing the platform. They are trying to figure out the problem across the two apps. The comments suggest that the actor normally has an input where the user can configure settings like the maximum number of pages to scrape. However, it's unclear if the Stack-AI integration allows setting this. Another community member mentions that the setting would be the maximum pages. Another community member is getting an error message about insufficient memory, indicating that the minimum memory required for this actor is 1024MB. The community members are discussing where this memory setting can be configured on Stack-AI.

Running a content crawler from Stack-Ai and repeatedly scraping only 100 pages. I am just testing out the platform so I am using a trial. Is that the problem? Just tracking down what the problem is across the two apps.
L
T
C
5 comments
The actor normally has an input where you can configure this and other settings. Does the Stack AI integration allow setting it? It was not developer by Apify
The setting would be maximum pages right?
I am getting this message when attempting to scrape a website : "You've set memory lower than the minimum of 1024MB allowed for this Actor". My account was overcharged and the usage was depleted. However, my account was subsequently credited with the amount overcharged. But now my queries won't execute due to insufficient memory. Thanks for your help.
I'm not sure where on Stack AI you can configure memory but 1024 is minimum for this actor (so it has reasonable speed)
Add a reply
Sign up and join the conversation on Discord