I’m using PuppeteerCrawler for scraping because it unblocks websites effectively and allows JavaScript execution. However, I’m facing an issue:
After accessing a website, I extract the required data from network requests (e.g., HTML) and parse it later with cheerio. At this point, I no longer need the browser, but I still want the Actor to continue running in the background to process and format the extracted data. Is there a way to close the Puppeteer browser mid-run to free up resources while keeping the Actor alive to handle the data?
Any guidance or examples would be greatly appreciated!
