Apify

Apify and Crawlee Official Forum

Home
Members
rico
r
rico
Offline, last seen 4 months ago
Joined August 30, 2024
rrico
·

proxy not working today?

Yesterday I was getting around my JavaScript skill issues by building a simple HTTP crawler on Elixir using the HTTPoison module.

It worked. Today I try the same code again and I’m getting an error. I tried different groups and no juice.
4 comments
A
r
p
rrico
·

Crawler stopped abruptly and exited with a success message

I'm running a crawler on Apify. Looking at the logs, the 2 messages stand out:
Plain Text
...
2024-08-06T22:02:30.894Z ERROR HttpCrawler: An exception occurred during handling of failed request. This places the crawler and its underlying storages into an unknown state and crawling will be terminated. This may have happened due to an internal error of Apify's API or due to a misconfigured crawler.

...

2024-08-06T22:02:34.090Z ERROR An error occurred during crawling:

FYI:
CPU
Average:8.95%
Maximum:29.11%

Memory
Average:179.2 MB
Maximum:335.1 MB

Request Queue tab:
NAME: Unnamed
TOTAL: 921
PENDING: 101
HANDLED: 820
READS: 995
WRITES: 3894
DELETES: 0
HEAD ITEM READS: 100
STORAGE SIZE: 196.7 kB


Any clues on how I can even begin to troubleshoot this?
6 comments
r
p
o