Apify and Crawlee Official Forum

Updated 5 months ago

limit dataset items

At a glance

The community members are discussing ways to limit the number of items in a dataset, beyond using a "limit" parameter. Some community members are unsure if such a parameter exists, while others suggest manually counting the items before adding them to the dataset. One community member notes that this functionality may be available for pay-per-result Actors, but there does not seem to be a general solution for limiting dataset size across the platform.

Is there any way to limit the amount of items in a dataset? besides the obvious, kind of like limit param
P
Y
9 comments
Hi , I don't understand, why is limit parameter not enough? Can you describe your use-case?
Hi, is there a limit param?!
I dont see it in the docs
I need to stop saving results once a certain amound of data has been collected
Hi I am sorry there currently does not seem to be a way how to limit the run for specific amount of results if it is not implemented by the Actor itself.
This is actually currently available on pay-per-result Actors.
I actually just count the items on the dataset before adding
Add a reply
Sign up and join the conversation on Discord