Everything logged twice?

At a glance

The post discusses an issue where everything is logged twice in a Scrapy template. Community members suggest that the issue should be reported as an issue on the template repository. One community member opens an issue and another community member confirms that the issue has been fixed. The community members discuss the fix and express their appreciation for the contributions.

Useful resources

HHonza Javorek

Any idea why everything is logged twice? Is this a known issue of the Scrapy template, or is it a desired behavior?

Plain Text

...
[scrapy.core.engine] INFO  Spider closed (finished) ({"spider": "<Spider 'startupjobs' at 0x1072ab890>"})
[scrapy.core.engine] INFO  Spider closed (finished) ({"spider": "<Spider 'startupjobs' at 0x1072ab890>", "message": "Spider closed (finished)"})
[twisted] INFO  (TCP Port 6023 Closed)
[twisted] INFO  (TCP Port 6023 Closed) ({"message": "(TCP Port 6023 Closed)"})
[apify] INFO  Exiting actor ({"exit_code": 0})
[apify] INFO  Exiting actor ({"exit_code": 0, "message": "Exiting actor"})

9 comments

HHonza Javorek

Should I put it here or as issue on the template repo? 🤔

VVlada Dusek

Hi Honza, could you please open an issue for that in https://github.com/apify/actor-templates/issues ? I have noticed this behavior before, however, so far not been able to get to it.

VVlada Dusek

I opened an issue for that - https://github.com/apify/actor-templates/issues/256, thanks for reporting it.

AApifyBot

just advanced to level 2! Thanks for your contributions! 🎉

HHonza Javorek

Thanks! I’ll subscribe there. If I happen to figure it out, I’ll report under that issue.

HHonza Javorek

Oh, I see it’s fixed 😀 That was quick! 🔥

HHonza Javorek

Awesome 💪

VVlada Dusek

Yeah, I made one more update, hopefully, now the logging will be without any problems in all of the parts of the Actor 🙂

HHonza Javorek

I implemented the patch today, but didnt have time to test it. I’ll just trust you 😀 If I see double logs again when I’m back at the repo, I’ll report back.

Add a reply

Apify and Crawlee Official Forum

Everything logged twice?