puppeteer crawler


#1

how to optimize puppeteer crawler ?


#2

Hi @Michel_Staples,

You can use block resources function from Apify SDK. You can also cache some web pages resources using cacheResponses function also from Apify SDK.

The main question is: Are you really need to scrape web with the puppeteer. If you can download data just with a plain request I’ll recommend using Cheerio crawler. It takes 100 times fewer resources than puppeteer crawler.

Have a nice day!