Apify

Apify and Crawlee Official Forum

b
F
A
J
A
Members
M. Shahzeb
M
M. Shahzeb
Offline, last seen last week
Joined October 7, 2024
Hello all.
I've been trying to build an app that triggers a scraping job when the api is hit.

The initial endpoint hits a crawlee router which has 2 handlers. one for the url-list scraping and the other for scraping the detail from each of the detail-page. (the url-list handler enqueues the next url-list page to url-list handler too btw)

I'm saving the data from each of these scrapes inside a KVstore but I want a way to save all the data in the KV store related to a particular job into database.
The attached screenshots are the MRE snippets from my code.
3 comments
M