Running out of space with pupeteers user profiles on a ...

Plain Text

"Failed to launch browser. Please check the following:\n- Check whether the provided executable path \"/usr/bin/google-chrome\" is correct.\n- Try installing a browser, if it's missing, by running `npx @puppeteer/browsers install chromium --path [path]` and pointing `executablePath` to the downloaded executable (https://pptr.dev/browsers-api)\n\nThe original error is available in the `cause` property. Below is the error received when trying to launch a browser:\n","stack":"Failed to launch browser. Please check the following:\n- Check whether the provided executable path \"/usr/bin/google-chrome\" is correct.\n- Try installing a browser, if it's missing, by running `npx @puppeteer/browsers install chromium --path [path]` and pointing `executablePath` to the downloaded executable (https://pptr.dev/browsers-api)\n\nThe original error is available in the `cause` property. Below is the error received when trying to launch a browser:\n\nError: ENOSPC: no space left on device, mkdtemp '/tmp/puppeteer_dev_profile-pXEfmi'\nError thrown at:\n\n    at PuppeteerPlugin._throwAugmentedLaunchError (/home/app/node_modules/@crawlee/browser-pool/abstract-classes/browser-plugin.js:145:15)\n    at PuppeteerPlugin._launch (/home/app/node_modules/@crawlee/browser-

5 comments

AApifyBot

just advanced to level 4! Thanks for your contributions! 🎉

bbmax

ENOSPC: no space left on device

PPepa J

Hi ,
Can you provide little bit more context? How much space is there available for the user-profiles? How mauch are the scraped websites using? What kind of user-profiles related files, takes the most space for you? How you tried any optimizations - like blocking some heavy not important requests? etc.

bbmax

I fixed this btw using code below

bbmax

Plain Text

        exec('rm -rf /tmp/puppeteer*', (error: Error | null, stdout: string, stderr: string) => {
          if (error) {
            console.error(`exec error: ${error}`);
            return;
          }
          console.log(`stdout: ${stdout}`);
          console.error(`stderr: ${stderr}`);
        });

Add a reply

Apify and Crawlee Official Forum

Running out of space with pupeteers user profiles on a long running scrape.