I'm exploring ways to optimize web crawling speed using Playwright. I'm curious if there's a method to navigate to new URLs without closing and reopening pages each time. Essentially, updating the URL in the address bar and initiating navigation.
Additionally, is there a way to disable the rendering of images, fonts, and stylesheets, assuming I only need access to the DOM? Any insights or tips would be greatly appreciated!
Hi, I'm afraid you can't re-use pages with the existing PlaywrightCrawler. I had a similar problem in this previous post, where I finally wrote my own crawler (I shared my code)