Apify and Crawlee Official Forum

Updated 5 months ago

pagination

At a glance

Hi all . is there any instagram post scraper that would allow me to scrape for example the first 30 posts . Get the result . And start scraping the next 30 posts . And so on until I run out of posts or until I interrupt the cycle. Thanks for reply )

4 comments

LLukas Krivka

I'm not aware of one but I didn't try all. Instagram uses cursor hash so you always have to "scroll" from the most recent

oolegPoleshko

Thank you for your reply . Is it possible to get the scraping results immediately when they hit the output . Instead of waiting for the actor to finish its work ?

Attachment

oolegPoleshko

I mean that I send a request for an actor's work through the api. I see that there are already first results in output but it is still a long way to the end of scraping. Can I get the results that are already displayed in the output?

vvojtechmaslan

Hello , you can access the dataset and it's items even when the run is still active, both via API (https://docs.apify.com/api/v2#/reference/datasets/item-collection/get-items) and console (under storage tab).

Add a reply