The community member is new to Apify and wants to know if it can be used to scrape websites that are not publicly accessible, such as corporate knowledge bases. They wonder if a proxy or other solution could be used to connect Apify to the private network and enable the scraping. A comment suggests that if the machine running the scraper has access to the private site, such as through a VPN, it should work like any other website. However, there is no explicitly marked answer to the community member's question.
Hello Friends! I'm new to Apify and pretty excited about what I've learned so far. One use case I'm not sure of: Can Apify be used to scrape a website that's not on the public internet? Specifically, I want to scrape knowledgebases inside corporations (with their permission). Is there for example some sort of proxy that could be put in place inside the private network that connects with Appify and then scrapes at Apify's direction? Or etc?
If the machine you're running the scraper on has access to the private site (e.g. through VPN), it should work like any other website. What error are you getting?
