Skip to content
  • Home
  • State Business Leads
  • Real Estate Data
  • Secretary Of State API
Cobalt Intelligence

Cobalt Intelligence

Data mining and web automation.

You Are Here
  • Home
  • Puppeteer

Category: Puppeteer

Puppeteer – How to Loop Through Multiple Elements
December 15, 2021December 26, 2021 Jordan Hansen

Puppeteer – How to Loop Through Multiple Elements

Puppeteer

We want to use Puppeteer to loop through multiple elements…and here we are going to show you how to do it! Puppeteer is a headless

Read More
How to Handle Puppeteer’s waitFor Deprecation
February 1, 2021September 27, 2021 Jordan Hansen

How to Handle Puppeteer’s waitFor Deprecation

Puppeteer

Puppeteer has deprecated waitFor! But it’s not as terrible as you think. There it is! Looking good!

Read More
Using Puppeteer with a proxy
January 4, 2021November 27, 2021 Jordan Hansen

Using Puppeteer with a proxy

Puppeteer

Sample code here This shows how to use Puppeteer with a proxy using both Luminati and Proxycrawl. Video guide: Luminati is a more intense solution

Read More
Getting Puppeteer working on Lambda.
December 28, 2020January 4, 2022 Jordan Hansen

Getting Puppeteer working on Lambda.

Puppeteer, Web Scraping

Very frustrating slight echo in this video. Sorry! Puppeteer on Lambda. Can it be done? Yes! I ended up using the chrome-aws-lambda package. It was

Read More
Avoid being blocked with puppeteer
December 30, 2019October 14, 2021 Jordan Hansen

Avoid being blocked with puppeteer

Learning to Web Scrape, Puppeteer

Demo code here One of the main questions I see on forums and reddit with regards to web scraping is…”how do I avoid being blocked?”.

Read More
Jordan Scrapes With Puppeteer
October 28, 2019October 20, 2019 Jordan Hansen

Jordan Scrapes With Puppeteer

Puppeteer

Demo code here I talk a lot about puppeteer in my posts. It’s one of my favorite tools for any web automation including web scraping,

Read More
Setting up Puppeteer on Ubuntu 18.04 and Digital Ocean
October 14, 2019January 4, 2022 Jordan Hansen

Setting up Puppeteer on Ubuntu 18.04 and Digital Ocean

Puppeteer

This is a tutorial on how to set up Puppeteer to work on Ubuntu 18.04 using a Digital Ocean droplet. While I will be going

Read More
Jordan Does Proxying With Puppeteer
August 19, 2019August 16, 2019 Jordan Hansen

Jordan Does Proxying With Puppeteer

Puppeteer

Demo code here On the shoulders of giants What I’m doing in this post is based primarily on this stackoverflow question. My main goal was

Read More
Jordan Upgrades Integration Tests and Includes Puppeteer-Firefox
May 20, 2019May 14, 2019 Jordan Hansen

Jordan Upgrades Integration Tests and Includes Puppeteer-Firefox

Integration Tests, Puppeteer

Demo code here – Pull request showing changes This post on further upgrading integration tests is based on the previous article that I did here

Read More
All Right Reserved 2019