Apify

Apify and Crawlee Official Forum

Updated 4 months ago

Disable persistant storage

At a glance
A community member is deploying a ParselCrawler to AWS Lambda and wants to disable persisting the storage. They have tried changing the configuration and supplying it to the ParselCrawler constructor, but the storage directory is still being created. The community member is asking if they are doing something wrong. There is one comment tagging another community member, but no explicitly marked answer.
TTomáš Linhart
·
Hi guys, I plan to deploy my crawler (a ParselCrawler one) to AWS Lambda. I'm loosely following this guide which is for JavaScript though. I'd like disable persising the storage. I change the configuration like this:
Plain Text
config = Configuration.get_global_configuration()
config.persist_storage = False

and also tried to supply the configuration to the ParselCrawler constructor, neither of these works though. I'm still getting the storage directory created. Am I doing something wrong here?
Thanks
O
1 comment
OOleg V.
cc @Vlada Dusek 🙏
Add a reply
Sign up and join the conversation on Discord