Apify and Crawlee Official Forum

Updated 4 months ago

Can I only add new businesses to an existing dataset?

At a glance

The community member uses a Google Maps scraper to gather business data from an entire country, such as "Furniture store" in Poland. They are wondering if there is a good way to update the existing dataset after a month, either by adding new items or removing items that can't be found, or if it's easier to just run the scraper from scratch again. A comment suggests that integrating a custom actor would be required for the update approach, and that running the scraper from scratch and comparing the difference would probably be easier.

Hi.
I use google maps scraper a lot.
I run it and get businesses from a whole country.
Example - "Furniture store" in Poland.
Is there a good way to take the existing dataset and after a month run it again but only add to it or remove items that can't be found?
Or is it easier to just run it from scratch?
L
Z
2 comments
Hello, this would currently require some integration around it (custom actor) which someone might help you in . From scratch and compare the difference will probably be easier
Ok. Thank you.
Add a reply
Sign up and join the conversation on Discord