If set to true, the crawler will automatically try to bypass any detected bot protection.
Currently supports:
Cloudflare Bot Management
Google Search Rate Limiting
maxRequestRetries=0
- is it OK to use retryOnBlocked
in such case?maxRequestRetries=0
can be used but in that case it will just fail completely