Apify and Crawlee Official Forum

Docker DNS Mapping Deployment

Hi, so I have a scraping actor that needs to fetch data from 'example.com', but it points to 123.123.123.123 instead, usually I add ip and domain in /etc/hosts file locally, how can I can achieve this via Docker or some other means in my Apify actors(Puppeteer)?

9 comments

SSaurav Jain

Hi, somebody from team will reply soon 🙂

RRado Ch.

Hi, I'm not entirely sure I 100% understood the problem 🤔 but I think it would be worthwhile to check out our documentation article for Dockerfile, as well as our Academy for Dockerfiles and Deployment

mmemo23

I have some entries in my /etc/hosts which I want to use in apify environment as well, how can i do that?

mmemo23

Any feedback? Running docker locally should give me some insights right?

SSaurav Jain

can you please help here?

mmemo23

has anyone run docker locally and try the scraper, I am having some issue when I want to build it locally, are there any resources to this?

SSaurav Jain

can you please help here

LLukas Celnar

Hi I've asked the team regarding you issue and I will update you once ill get an answer
In the meantime i recommend you this article about building and running dockerfile locally
https://www.docker.com/blog/getting-started-with-docker-using-node-jspart-i/

mmemo23

thanks, I hope question is clear, I just want to take entries from my 'hosts' files and add it docker, so when I hit certain url or domain it goes to that IP address (from hosts), I already tried few scenarios but it seems it doesn't work

Add a reply

Join on Discord