A community member developed a NewEgg scraper actor and is having trouble, as they believe NewEgg has increased its anti-bot protection during the holiday season. The code works locally using residential proxies, but fails when running on the Apify platform. The community members discuss this issue, noting that the same code behaves differently when run locally versus on the platform. They speculate that the extra anti-bot measures may be temporary and related to the holiday season. One community member mentions that they were able to successfully scrape a specific NewEgg URL using a simple request, indicating that the issue may be temporary or specific to the community member's setup.
So, I developed the NewEgg scraper actor, and I’m having some trouble, particularly because I think NewEgg upped their anti-bot protection during holiday season.
However, something weird is happening, when I run the code locally using your residential proxies, it sometimes fails, but generally it doesn’t, specially after I implemented UA Rotation.
But, from Apify (and from your maintenance runs), it always fails, this kinda indicates to me that it’s not being able to properly connect to your residential proxies via the platform.
