AWS tools for web scraping (Lambda, DynamoDB, EventBridge, CloudWatch)

A tutorial going through AWS for the various tools used at Cobalt Intelligence for web scraping or just work in general.

We use AWS Lambda for functions that do the 99% of our work. They are scheduled and include inserting, deleting, and exporting data. DynamoDB is the database that we use to store and manage data. CloudWatch we use to debug and just log anything that happens. EventBridge is something we use to schedule our functions.

Sample repo – https://github.com/cobalt-intelligence/aws-tools-example

AWS CLI – https://aws.amazon.com/cli/