Apify and Crawlee Official Forum

Updated 5 months ago

Multiple dataset output schemas to show scrape data in Apify console UI

At a glance

The community member has set up two named datasets in their actor.json file, but the Apify UI is not displaying the scraped data saved in these datasets. The community member is concerned that users will not know if the data has been saved unless they check each dataset individually.

In the comments, another community member explains that the current Apify UI only shows the default dataset, and that the user can access other datasets by going to the "Storages" tab and using the dataset selector. However, if the user does not use the default dataset, the output view will not show the data. The community member suggests that the user can create more views (not different datasets) to display the data, and provides links to relevant documentation.

The original community member thanks the other community member and says they will try this approach since they are using two named datasets instead of the default dataset.

Useful resources
"storages": {
"companyInformationDataset": "./dataset_company_information_schema.json",
"reviewsDataset": "./dataset_reviews_schema.json"
}

I have these storage schemas in actor.json file but Apify UI does not pick up to use them to display scraped data that has been saved in them. So Users do not know if scraped data was saved unless they check each named dataset. I don't save data to unnamed dataset.
Attachment
image.png
S
C
3 comments
Hey , someone from the team will reply you soon.
That is not how it works. At least not for now, there will be feature like this in the future, but currently there is only one dataset under storages . We show in the UI other datasets which were accessed during the run. To do that the user can go to storages tab and there under datasets should be a selector.

But if the user does not use the default dataset, the output view will always look like this.

You can have more views (not different datasets): https://docs.apify.com/academy/deploying-your-code/output-schema and https://docs.apify.com/platform/actors/development/actor-definition/output-schema
Thanks I will try this since I dont use default dataset -i use 2 named datasets
Add a reply
Sign up and join the conversation on Discord