Apify

Apify and Crawlee Official Forum

b
F
A
J
A
Members
Teodor
T
Teodor
Offline, last seen last month
Joined August 30, 2024
Hi everyone I'm trying to use the cli to create a new javascript, crawlee + cheerio project
However I get the error :
Plain Text
 Error: EINVAL: invalid argument, mkdir 'C:\Crawlee-latest\Crawlee\my-new-actor\C:'

It seems that is automatically adds a "C:" at the end of my current terminal path which I believe makes it to fail ( the installation of the project is not complete as I'm missing modules(like cheerio, etc) I have only crawlee and apify in my package.json file of the project.


Currently using node@20.17.0 64-bit , apify-cli@0.20.6 , apify@3.2.5 , crawlee@3.11.2 and Windows 11
3 comments
T
P
Hi everyone has anyone had success in scraping lazada retailer (i.e. https://www.lazada.co.th/products/2511-2-5-i5008341785-s21162506684.html) .
This is just 1 country example, they are active on multiple markets ( th, my, vn, sg, id).
I've had success in crawling the store pages using &ajax=true in their url of a store and retrying the request until it works.
i.e https://www.lazada.co.th/junkins/?q=All-Products&from=wangpu&langFlag=th&pageTypeId=2&ajax=true .
However I didn't had any success in accessing the product page itself as it always gives me a captcha which is not solvable and just asks you refresh the page.
I've tried puppeteer with live cookies generated from a 3rd party service with residential proxies and different puppeteer configs.
Tried to mimic a user as much as possible however I'm still getting blocked.
I'm using puppeteer on version-3.

Can anyone help find a solution to access their product page with a bot ?
Thanks in advance!!!
1 comment
M
Hi everyone has anyone had success in scraping lazada retailer (i.e. https://www.lazada.co.th/products/2511-2-5-i5008341785-s21162506684.html) .
This is just 1 country example, they are active on multiple markets ( th, my, vn, sg, id).
I've had success in crawling the store pages using &ajax=true in their url of a store and retrying the request until it works.
i.e https://www.lazada.co.th/junkins/?q=All-Products&from=wangpu&langFlag=th&pageTypeId=2&ajax=true .
However I didn't had any success in accessing the product page itself as it always gives me a captcha which is not solvable and just asks you refresh the page.
I've tried puppeteer with live cookies generated from a 3rd party service with residential proxies and different puppeteer configs.
Tried to mimic a user as much as possible however I'm still getting blocked.
I'm using puppeteer on version-3.

Can anyone help find a solution to access their product page with a bot ?
Thanks in advance!!!
1 comment
M