By nikomelf
Connected Tutorial(This question is a follow-up to this tutorial):
How To Build a Concurrent Web Scraper with Puppeteer, Node.js, Docker, and KubernetesHello there. Thank you so much Carlos Mucuho for sharing this example! I’m wondering what do i need to do change in order to make it run against multiple browsers. Thank you again!
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
In order to run the web scraper against multiple browsers, you would need to make some changes to the setup. You’d need to use a library that supports multiple browsers or have separate instances of your scraper running with different browser engines. One option is to use a library like Playwright that supports Chromium, Firefox, and WebKit out of the box.
When running the scraper with Docker and Kubernetes, you can increase the number of replicas in your deployment to create multiple instances of your scraper, which can be used with different browser engines.
For more information on using multiple browsers, you can check out Playwright’s documentation. For reference on the tutorial you mentioned, please visit How To Build a Concurrent Web Scraper with Puppeteer, Node.js, Docker, and Kubernetes on our community page.
Hope that this helps!
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and SMBs
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Get started for free
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.