I have a crawler I have setup (x) that collects links from a page. I want to run another crawler(y) within x crawl to collect more data and return it with the rest of x crawl data. Is it possible to do this?
(I know you can add requests to the queue from a crawl but I want to keep the data together)
example data structure:
Plain Text
const data = [{
// from "x" crawl
title: 'a page',
links: [
{
// from "y" crawl
title: 'a page',
link: 'link'
}
]
}]
I installed using templates (typescript example and playwright typescript example) on multiple operating systems (windows & ubuntu via vmware) and ran into the error "state.conditions.includes is not a function). I tested the basic js template and had no issue.
I went back to the ts project and updated to latest typescript(5.3.2) and tried again, same error. I then installed 5.1.6 and it worked.
