Apify and Crawlee Official Forum

Updated 2 weeks ago

Crawlee Playwright is detected as bot

Checking on this page, Crawlee Playwright is detected as bot due to CDP.

https://www.browserscan.net/bot-detection

This is a known issue, also discussed on:

https://github.com/berstend/puppeteer-extra/issues/899

Wondering if Crawlee can come up with a solution?
6
A
S
L
11 comments
@Jeno just advanced to level 2! Thanks for your contributions! πŸŽ‰
checking with team and getting back to you.
Hi @Jeno
We are working on solution that will not use Playwright and should be more unblockable.
Meanwhile you can checkout these tips https://docs.apify.com/academy/anti-scraping#quick-start
That's exciting news!
Very interesting, @Jeno pls look at this screenshot.
As far as i understand: "Normal" = "Nothing detected", right?

Code: Playwright+Crawlee+Firefox+rotating proxies.

And exactly same program is detected on another site, see here:
https://discord.com/channels/801163717915574323/1296398744870457394
Attachment
www.browserscan.detect.png
Can you give a hint at what stage that new solution is? Weeks or months away? Or next major version?
I wanna know that too. It is a great feature .πŸ‘
I wonder, is this an issue with fingerprint-suite or the PlaywrightCrawler implementation?
Add a reply
Sign up and join the conversation on Discord