Apify

Apify and Crawlee Official Forum

b
F
A
J
A
Members
gablabelle
g
gablabelle
Offline, last seen 3 weeks ago
Joined August 30, 2024
Hello there!

Beside reducing the scope of what is being crawled, for example of number of pages, etc, what can we do in order to accelerate the run?

Any suggestions are welcomed, I'm simply curious.
3 comments
R
R
Hello,

Can we run crawlee in Vercel Edge functions? The interesting this with edge functions, besides the fact that it's cheaper, is that it doesn't have a maximum execution timeout as long you keep streaming back something to the client.

Followed the instructions here since I was getting the same puppeteer error: https://discord.com/channels/801163717915574323/1178072249362813009

It works fine in a "normal" serverless API routes but I get Error [ReferenceError]: crawlee is not defined when in edge functions.
Hello,

Can we run crawlee in Vercel Edge functions? The interesting this with edge functions, besides the fact that it's cheaper, is that it doesn't have a maximum execution timeout as long you keep streaming back something to the client.

Followed the instructions here since I was getting the same puppeteer error: https://discord.com/channels/801163717915574323/1178072249362813009

It works fine in a "normal" serverless API routes but I get Error [ReferenceError]: crawlee is not defined when in edge functions.