Announcing BrowserQL, our next-gen automation tooling

Browserless Blog

Advice and stories from our team about working with Puppeteer and Playwright.

July 14, 2025

Best Language for Web Scraping: Python vs JavaScript A Practical Comparison

Compare Python and JavaScript for web scraping: tools, performance, and real-world examples. Discover how Browserless simplifies scaling scraping in any language.

July 8, 2025

Web Scraping vs Data Mining: Understanding the Differences, Use Cases & Best Practices

Understand the differences between web scraping and data mining, and learn when to use each method individually or in combination. Get real examples, tools, best practices, and code walkthroughs for smarter data strategies.

June 26, 2025

Browserless Hybrid Automation: Faster Speed, Mobile Power, and Seamless Human + Bot Workflows

Discover how Browserless Hybrid Automation blends bots and humans across desktop and mobile web, unlocking faster, smarter, and more scalable workflows.

June 13, 2025

Modern Python Web Scraping with Browserless + AI: Smarter, Faster, Easier

Learn how to streamline Python web scraping with Browserless and AI tools. Faster setup, better scaling, and smarter script generation without local browser headaches.

June 10, 2025

Using Browserless + n8n + AI Agents to Power Smart Web Automation Workflows

Discover how to build smart, scalable web automation workflows using Browserless, n8n, and AI agents like Claude or ChatGPT. Learn from real-world examples that cover pricing intelligence and lead qualification.

May 29, 2025

Scaling Laravel Dusk with Browserless: Automate More with Less Chrome Overhead

Offload heavy browser tasks from Laravel Dusk using the Browserless SDK to render PDFs, capture dynamic content, and scale browser automation without crashing CI.

May 22, 2025

Scraping with Playwright: A Developer’s Guide to Scalable, Undetectable Data Extraction

A hands-on developer guide to scraping JavaScript-heavy websites with Playwright. Learn how to scale, avoid detection, and automate scraping tasks with BQL.

May 20, 2025

The Ultimate Guide to Puppeteer Web Scraping in 2025

A practical deep dive into scraping modern websites with Puppeteer in 2025. Learn how to deal with JavaScript rendering, CAPTCHAs, SPAs, and scale your scrapers with Browserless.

May 16, 2025

Bypass Cloudflare with Puppeteer

A hands-on guide to bypassing Cloudflare using Puppeteer. Learn how to use stealth plugins, proxy rotation, and CAPTCHA solvers to scrape even the most protected websites.

May 13, 2025

Bypass Cloudflare with Playwright

Cloudflare makes scraping tough, but not impossible. Learn how to use Playwright, stealth plugins, proxies, and even Browserless BQL to defeat modern bot protection.

April 28, 2025

How to Migrate from Selenium Grid to BrowserQL

Learn how to transition from Selenium Grid to BrowserQL with a step-by-step guide. Simplify your browser automation and remove infrastructure overhead.

April 28, 2025

How to Scrape Etsy with BQL

Discover how to easily extract product listings, prices, and seller details from Etsy using BQL Handle CAPTCHAs, bot detection, and dynamic content.

April 11, 2025

How to Use Browserless with CrewAI

Learn how to supercharge CrewAI agents with Browserless to scrape real-time web data efficiently. Reduce token usage, bypass bot detection, and extract information like a pro.

April 3, 2025

Build a ChatGPT Operator Alternative, with DeepSeek + BrowserQL

Build your own AI agent with browser control, similar to ChatGPT’s Operator, using DeepSeek and BrowserQL

March 27, 2025

How to Scrape Glassdoor with BrowserQL

Discover how to extract job listings, salaries, and company reviews from Glassdoor using BQL. Overcome challenges like CAPTCHAs, bot detection, and dynamic content with an efficient scraping workflow.

March 27, 2025

Scraping Network Requests: How It Works and Why It Matters

Learn how to scrape network requests to extract data more efficiently. Discover how request and response monitoring provides cleaner, faster access to structured data from modern websites.

March 12, 2025

Simplified Web Scraping With Our New Mapping Feature

Our new mapping feature makes web scraping easier by allowing developers to extract structured data with minimal code. Learn how to use mapSelector to streamline your workflow and handle dynamic content efficiently.

February 21, 2025

Cutting Proxy Usage with Reconnects

Reduce proxy usage by up to 90% with reconnects. Learn how to optimize web scraping workflows using BrowserQL for session reuse, speed, and efficiency

February 14, 2025

How To Bypass Cloudflare When Scraping

Struggling with Cloudflare blocking your scrapers? Learn how to bypass bot detection, handle CAPTCHAs, and rotate IPs using open-source tools and BrowserQL.

February 11, 2025

Guide to JavaScript and Node.js Web Scraping

Learn JavaScript and Node.js web scraping with Axios, Cheerio, Puppeteer, and BrowserQL. Handle dynamic content, CAPTCHAs, and bot detection for scalable workflows.

February 7, 2025

How to Scrape Protected Websites with ChatGPT

How to scrape websites with ChatGPT, including bypassing bot detectors using BrowserQL.

February 4, 2025

How to Scrape Shopify Stores with BrowserQL

Discover how to easily scrape Shopify stores for pricing, inventory, and product data with BQL.

January 30, 2025

How to Scrape Indeed with BrowserQL

How to scrape Indeed, including bypassing bot detection using BrowserQL

January 22, 2025

How to Scrape Reddit with BrowserQL

How to scrape Reddit, including bypassing bot detection using BrowserQL

January 14, 2025

How to Scrape Walmart.com with BrowserQL

How to scrape Walmart, including getting past bot detectors using BrowserQL

January 7, 2025

How to Scrape Yelp With Browserless

Learn how to scrape Yelp data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

December 18, 2024

How To Scrape Zillow With Phone Numbers

How do you scrape Zillow with phone numbers? Read our complete guide here.

December 16, 2024

How to Download Files from Remote Browser Connections, With Puppeteer and Playwright

How to automate file downloads from a remote browser, using Puppeteer and Playwright, complete with sample scripts

December 12, 2024

How to Scrape eBay Using Browserless

Learn to scrape eBay data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

December 5, 2024

How to Scrape Booking.com With Browserless

Learn to scrape Booking.com data with Browserless. Follow our step-by-step guide with anti-bot techniques to save time and boost your data collection ROI.

November 14, 2024

Announcing BrowserQL, Our Next-Gen Scraping And Automation Tool

Check out BrowserQL, our new browser automation tool. It has minimal fingerprints to get past even the toughest detectors, and a dedicated IDE and query language so you can write complex automations in a couple dozen lines.

November 7, 2024

How to Deploy Puppeteer on GCP Compute Engines, Complete with Dependencies

How to deploy Puppeteer on GCP Compute Engines, complete with separate Chrome browsers and missing dependencies.

November 1, 2024

What are AI Digital Employees—and How are They Different From Regular AI Agents?

AI agents have become increasingly popular due to their ability to optimise business processes. But how do they work? Check out our guide to learn more.

October 29, 2024

How to Deploy Playwright on GCP Compute Engines

How to deploy Playwright and Chrome on GCP Virtual Machines, complete with VM selection and dependencies.

October 25, 2024

Searching API URLs and Extracting Objects with Puppeteer and Playwright

How to automatically find relevant JSON API URLs and the values within them, with libraries such as Playwright and Puppeteer.

October 17, 2024

A Guide to AI-Driven Testing (Benefits, Challenges and Strategies)

Learn about how AI can help with different types of automated software tests and the best tools to use.

October 10, 2024

How to Deploy Playwright on Azure VMs, Complete with Dependencies

How to deploy Playwright and Chrome on Azure Virtual Machines, complete with working dependencies.

October 4, 2024

How to Deploy Puppeteer on Azure VM, Complete with Dependencies

How to deploy Puppeteer on Azure Virtual Machines, complete with separate Chrome browsers and missing dependencies.

September 26, 2024

Patterns and Anti-Patterns in Web Scraping

How to avoid inefficient or unreliable unreliable web scraping, by swapping anti-patterns for patterns.

September 17, 2024

How to Deploy Playwright on AWS EC2

How to deploy Playwright and Chrome on AWS EC2, complete with advice on depencies, operating systems and configuring the environment.

September 13, 2024

How to Deploy Puppeteer on AWS EC2, Including Setup and Dependencies

How to deploy Puppeteer on AWS EC2, complete with tested solutions for OS compatibility and missing dependencies.

September 6, 2024

Selenium Alternatives: Choosing the Best Tool for Your Testing

Not sure if you should use an alternative to Selenium? Check out our guide on the top 5 choices and when you should choose them.

August 30, 2024

How to Debug Playwright & Puppeteer Automations With Effective Logging

Debugging automations without the right logs wastes time and resources. Check out our guide to learn how to set up logs and efficiently troubleshoot issues.

August 21, 2024

How to Select and Maintain CI Runners for Playwright

How to fix slow or flaky CI/CD test suites, through properly upgrading and maintaining test runners. Covers symptoms of small runners and how to plan an upgrade

August 8, 2024

Event Handling and Promises in Web Scraping

How to avoid common anti-patterns in web scraping, particularly in event handling and promises, including detailed code examples.

August 1, 2024

How to Create High Framerate Puppeteer Screencasts With Audio, Using Browserless

Struggling with screencasting using Puppeteer? It’s time to switch. Read our guide on how to use Browserless’ API to easily generatehigh quality videos.

July 26, 2024

Deploying Playwright on Google Cloud Functions

Use this tutorial to learn how to integrate Playwright with GCP, with code examples for deploying Chrome in a Function for seamless automations.

July 18, 2024

How to Run Puppeteer Within Chrome to Create Hybrid Automations

If you’re finding it hard to automate browser tasks due to security challenges, learn how to nest browsers for powerful hybrid automations in this guide.

July 16, 2024

Hiring - Senior Product Engineer

We're now hiring a a Senior Product Engineer to join our team.

July 11, 2024

Why HTTP load tests fail to catch critical errors

Why your load tests should include browsers as well as API call, and how to handle the required infrastructure.

July 5, 2024

How to Deploy Playwright on an Azure Functions App

Want to deploy Playwright on an Azure Functions App? This 4-step guide will show you how to get past size limitations and automate browser tasks.

June 28, 2024

How to Run Playwright Automations on Heroku

Looking to automate browser tasks on Heroku? Use this tutorial to learn how to integrate Playwright for seamless browser automation in the cloud.

June 19, 2024

Keep Puppeteer browsers alive with our Reconnect API

How to reuse a Chrome instance for multiple Puppeteer scripts with our /reconnect API, to speed up scraping or avoid repeat log ins.

June 13, 2024

How to Run Parallel Lighthouse Tests In Your CI Pipeline

How to run high volume Lighthouse tests as part of your continuous integration pipeline. Includes an overview of the benefits, and running concurrent tests with Browserless's /performance API

June 7, 2024

Join us at the 2024 edition of The Browser Conference

Join us at the next edition of the Browser Conference, featuring talks from Google, Sauce Labs and Selenium

June 6, 2024

How to Deploy Puppeteer on Google Cloud Functions

Looking to deploy Puppeteer on GCP? This guide includes the code required to run Puppeteer in a Function, including dealing with challenges such as compressed browsers.

May 29, 2024

How to Fix Slow Puppeteer Scripts With Three Underused Techniques

Common issues that cause slow Puppeteer scripts and how to fix them with underused features.

May 22, 2024

How to Deploy Puppeteer on Azure Functions for Browser Automation

How to deploy Puppeteer on Azure Functions, including instructions for using compressed browsers compatible with file size limits and saving outputs to a blob.

May 7, 2024

How to run Puppeteer on Heroku for Web Automation

Want to automate tasks on the web using Puppeteer-core and Heroku? This tutorial will walk you through the process and help you get started quickly.

April 29, 2024

How to Deploy Playwright on AWS Lambda

How to move your Playwright scripts onto AWS Lambda, with code examples for the required library files and layers.

April 24, 2024

How we manage individual user concurrencies with Nginx and Lua

A behind the scenes of how we manage fluctuating browser concurrency limits across our thousands of users.

April 12, 2024

Case Study: How My AskAI use Browserless to give their chatbots access the web

How My AskAI used Browserless to skip the deployment headaches of Puppeteer, and gives their AI agents internet access.

March 28, 2024

Automatically solve any captcha as part of your Playwright or Puppeteer script

Easily add captcha solving to your Puppeteer or Playwright scripts with our API, for web scraping and other automations.

March 22, 2024

How to run Playwright on Netlify

How to deploy Playwright on Netlify for testing or other automations, including advice on hosting headless browsers.

March 21, 2024

Stream login windows during Puppeteer scripts, with our Hybrid Automations

Screencast to an iframe while running a Puppeteer script, for actions such as entering details, solving captchas or authorizing a 2FA.

March 20, 2024

How to Deploy Puppeteer on AWS Lambda

How to deploy Puppeteer on AWS Lambda, including the use of puppeteer-core and sending generated files to an S3 bucket.

February 29, 2024

Deploying Playwright with Vercel for Effective End-to-End Testing

How to deploy Playwright on Vercel, with separately hosted browsers. Complete with code examples, you'll be up and running in no time.

February 28, 2024

How to use our new and improved SDK for Browserless v2

Diving into what's possible with Browserless's updated SDK and how to use it. Extend, modify or even re-implement parts of Browserless.

February 26, 2024

Announcing the /unblock API from Browserless, a new approach to dodging bot detectors

The /unblock API clears away bot fingerprints at the CDP level, to truly humanize your Puppeteer automations.

February 21, 2024

How and why we ripped our OS product apart for a full rebuild

Our battle with tech debt and the full details of completely rebuilding an open source product for v2.

February 20, 2024

How to use Puppeteer with Netlify

How to use Puppeteer on Netlify for tasks such as screenshots or PDF exports. This guide uses puppeteer-core with a separate Chrome instance.

February 15, 2024

How to Use Scrapy on Dynamic Sites, Without Playwright or Selenium

How to run Scrapy on our fleet of headless browsers, via our /content API. Run your existing scripts with a minimal code change, no need to touch Playwright, Puppeteer or Selenium.

February 13, 2024

Case study – How Semji create HTML snapshots for their SEO platform

How Semji ran their Puppeteer automations using Browserless, to generate HTML screenshots for their AI SEO tool.

February 2, 2024

Interview with Ben Fellows: Life Running a Top Quality Assurance Agency

Discussing the ins and outs of running a QA agency, including the realist's approach to continuous delivery and testing with Playwright.

January 23, 2024

How to Optimize Puppeteer Automations

Speed up your Puppeteer scraping and automations with practical tips on reusing browsers, cache management, and resource optimization.

January 17, 2024

Intelligent Data Extraction: What, Why, and How

Discover the transformative impact of intelligent data extraction for businesses. Dive into its significance, benefits, and the methodology behind turning vast amounts of raw data into actionable insights.

December 20, 2023

Case Study: How Takeoff Copenhagen got a 5x speed boost and reliable proxies for scraping with Browserless

Read how switching to Browserless helped Takeoff get reliable proxies, cut their bill and run faster scraping scripts.

December 18, 2023

Running scripts for Browserless using Zapier

You can run automations fully on the cloud by using Browserless with Zapier. Here's a quick guide on how to set up your first Zap.

December 15, 2023

How to generate Puppeteer scripts with Chrome's recorder

How to turn website interactions into Puppeteer scripts using Chrome's inbuilt Recorder, then run them through Browserless's API with a few tweaks.

December 13, 2023

Migrating from Selenium to Playwright

Outlining the advantages of Playwright over Selenium, with a detailed guide for how to convert your scripts and ditch the Grid.

December 6, 2023

browserless 2.0.0

We’re more than excited to announce today that we’ve rewritten browserless.io from the ground-up, and will be releasing it soon!

December 5, 2023

Advanced issues when managing Chrome on AWS

Key points to consider when hosting headless Chromium on AWS, for both EC2 and Lambda deployments

September 24, 2023

Announcing a residential proxy for browserless.io

We're excited to announce that we now have a built-in residential proxy for our paid cloud plans on browserless!

September 5, 2023

How to extract travel data at scale with Puppeteer

August 31, 2023

Headless Chrome with a GPU instance is fast!

The Power of GPU in Headless Chrome: Elevating Performance and Experience

August 22, 2023

WaitUntil option for Puppeteer and Playwright

Picking the best waitUntil option to use can be tricky, let's dive into the details of how each one works and how to pick the best one for each scenario.

July 18, 2023

Browserless now runs in LangChain

We’ve begun the process of integrating Browserless with the popular LangChain AI library, starting with Browserless’ REST APIs.

June 14, 2023

Using browserless to train your LLM

Large language models are only as good as the data you ingest into them. Read more about browserless and how to us it to train your LLMs!

March 13, 2023

Announcing a new puppeteer benchmarking tool

Announcing a new puppeteer benchmarking tool to see how puppeteer performs version over version.

February 23, 2023

Scaling Puppeteer and Chrome Horizontally

This guide includes all the snippets you need to succeed at scaling puppeteer and chrome horizontally by using tools like nginx and docker.

February 2, 2023

Why we pick Puppeteer over Selenium almost every time

Choosing between Selenium and puppeteer can be hard, here's some suggestions of what we've found over the past several years to help.

December 30, 2022

Web Scraping Business Ideas for Everyone

In this article, we'll show you 12+ different web scraping ideas to use in your job or life.

December 8, 2022

Introducing Unit-based Pricing

New unit-based pricing is intuitive, predictable, and includes 7-day trial. Try Browserless today for free.

December 7, 2022

Turning sites into structured data | How to get JSON file from Wikipedia

In this article, we'll show you how you can turn any site into a structured data. The example is Wikipedia website to JSON.

October 18, 2022

What is Data Scraping? The Tutorial for Beginners

In this article, we'll answer on "what is Data Scraping" and how you can use Browserless to start scraping web data.

September 16, 2022

The best open source web automation tools for 2022

In this article, we'll share the best open source web automation tools and libraries for 2022. Check out to find your fav tool!

September 16, 2022

What is Browser Automation? Guide to Get Started

In this article, we'll cover different browser automation use cases, tools and how to get started with automating browsers.

September 2, 2022

Getting started on web scraping with Selenium WebDriver and Python

In this article we'll show you how to use Selenium for web scraping. We'll show you a real example of how python web scraping works.

August 26, 2022

Zillow scraper guide | How to build your own Zillow web scraping tool

In this article we'll share real code that will let you build your own Zillow scraper tool. Copy & paste it to start your Zillow scraping.

August 26, 2022

Getting started with Website Test Automation | Browserless guide

In this article, we'll dive deeper into web automation test examples. We'll share a few use cases on website test automation.

We have been writing, using and deploying headless browserless workloads for nearly 10 years.

We're committed to making headlessbrowser workloads as painless aspossible! I knew a solution like Browserlesscould dramatically simplify the work andmaintenance, but none existed, so Istarted Browserless.

Joel Griffith,
Founder & CEO