In my Python script, where possible should I scrape a set of URLs in the same run? I am wondering if doing each url in separate runs costs more due to the starting and restarting of the Apify client vs doing them in one run.
Google Maps returns varying results for a search term with the same query. Does anyone have a good strategy by which you can get as many unique results as possible if you were to reuse the scraper for the same search term? Or is it not possible?
I am using the twitter scraper in Python and finding that on the browser console I am getting all 300 tweets that I request. I have a counter in my Python script that increments with each item in the client.dataset(run['defaultDatasetId']).iterate_items(). This ends up being around 90, so it seems I am only getting 1/3rd of the tweets I scrape. Anyone know why or recommend what to do?
Does anyone find the YouTube scarper starts OK but then comes to a halt around 50 videos? This is when scraping a channels videos. Anyway to get around this?
