Apify

Apify and Crawlee Official Forum

b
F
A
J
A

New fingerprint per new request with PlaywrightCrawler/Firefox ?

Hi all,
what I want to achieve:

  • every request should have unique fingerprint - this is important!
  • cookies, etc. not shared between requests
  • PlaywrightCrawler
  • no sessions - every request is independent, (no login or similar)
  • Firefox
  • performance/throughput is not a number one prio
At the moment I almost have this with the hack retireBrowserAfterPageCount=2 in browserPoolOptions: this gives a unique fingerprint every two requests, which... isn't perfect (and starting a new browser instance so often looks strange)

In this thread: https://discord.com/channels/801163717915574323/1060467542616965150
a solution for browser pool (without crawler) was suggested.

I would like to have both: new fingerprint per request and PlaywrightCrawler.
Is it possible?
L
1 comment
Well, you can do retireBrowserAfterPageCount=1, it just has a bit worse performance since it needs to open new browser window every time.

Second option is to try hacky https://crawlee.dev/api/puppeteer-crawler/interface/PuppeteerLaunchContext#experimentalContainers
Add a reply
Sign up and join the conversation on Discord
Join