This is so that Playwright can fill in and submit a website search page which uses dynamic Javascript. When the results are shown I want to be able to use the BeautifulSoup crawler to open each product page and parse the information. If I use Playwright to open each product page, this takes a very long time. I cannot seem to run both Crawlers at the same time.
I want to build my own actor with playwright and BeautifulSoup. I am looking for this exactly solution. first I want to send a Http request and get the HTML and use the beautifulSoup to parse the data and then open the Links (get from parsing the data) using playwrights .
correct me If I am wrong. first use the python with beautifulSoup and get the results and use those result with Playwright. so we have to create and build 2 different actor for this ?