Apify

Apify and Crawlee Official Forum

b
F
A
J
A
Members
Muhammet
M
Muhammet
Offline, last seen 2 hours ago
Joined September 19, 2024
As far as I can see, when a user manually stops the actor from running, this decreases the success rate. I think the platform recognizes this as a fail. Do manual stops by the user affect the success rate? Is there any way to prevent this or will there be a solution for this?
1 comment
M
Hi guys 👋 , my Apify actor can pull data from the website even though the robots.txt setting is “TRUE”. When I test it on my own server, it complies with robots.txt rules. Doesn't Apify automatically follow robots.txt rules? Can't we set it manually? I haven't found any documentation on this.
1 comment
O