Apify Discord Mirror

Updated 5 months ago

pagination

At a glance

The community member is looking for an Instagram post scraper that can scrape the first 30 posts, get the results, and then move on to scraping the next 30 posts, repeating the process until they run out of posts or interrupt the cycle. In the comments, another community member suggests that Instagram uses a cursor hash, so you always have to "scroll" from the most recent posts. The community member then asks if it's possible to get the scraping results immediately as they are displayed in the output, instead of waiting for the entire process to finish. Another community member responds that you can access the dataset and its items even when the run is still active, both via the API and the console.

Useful resources
Hi all . is there any instagram post scraper that would allow me to scrape for example the first 30 posts . Get the result . And start scraping the next 30 posts . And so on until I run out of posts or until I interrupt the cycle. Thanks for reply )
L
o
v
4 comments
I'm not aware of one but I didn't try all. Instagram uses cursor hash so you always have to "scroll" from the most recent
Thank you for your reply . Is it possible to get the scraping results immediately when they hit the output . Instead of waiting for the actor to finish its work ?
Attachment
image.png
I mean that I send a request for an actor's work through the api. I see that there are already first results in output but it is still a long way to the end of scraping. Can I get the results that are already displayed in the output?
Hello , you can access the dataset and it's items even when the run is still active, both via API (https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items) and console (under storage tab).
Add a reply
Sign up and join the conversation on Discord