Apify Discord Mirror

Updated 5 months ago

Scraping instagram profiles

At a glance

The community member tested the apify/instagram-scraper tool, but found that it did not provide all the data they needed. They discovered that the required data could be obtained by making a request to a specific Instagram URL, but this required being logged in. The community member turned to Apify to see if they could scrape the same data without needing to log in.

In the comments, other community members discussed the challenges of scraping Instagram data without login credentials. They mentioned that Apify had removed login-based scraping for Meta services due to legal reasons, and that certain data may be partially missing without login. The community members indicated that they could not use login in a public actor, and that there is currently no way around this limitation.

Useful resources
I just tested out the apify/instagram-scraper. Specifically, the profile data retrieval part of it. But unfortunately it doesn't have some data I need.
I can get the data I need by going to: https://www.instagram.com/{username}/?__a=1&__d=dis, but this supposedly requires me to be logged in, so I turned to apify to see if I could scrape the same data I need. Attached is an image that has the data I'm looking for, highlighted-

Is it possible to scrape this data through apify, ideally through a pre-built actor in the store already?
Attachments
image.png
image.png
B
A
7 comments
Scraping instagram profiles
Forwarded request to support, they will confirm and update in 1-2 work days, thanks for feedback!
If it matters,
one way I found to get this data programmatically- it's possible to use a cURL get request with a sessionid cookie in the header set to a real session id from a logged in account (the url being https://www.instagram.com/{username}/?__a=1&__d=dis of course)
Cookie: sessionid
Session is login hash and login-based scraping for Meta services was removed permanently from Apify last year because of legal reasons. Is it still worth for you to add this data? We know that most of the time values set to empty without login and so far there is no way around.
We can not use login of any kind in public actor, without login certain data partially missing, like business-alike items you referenced.
Add a reply
Sign up and join the conversation on Discord