Overview

This is a containerized web scraper and mongodb to pull tournament data from various poker sites

How to run

1. cd poker_tournament_scraper
2. yarn install
3. docker-compose up -d mongo
4. Wait about a minute for the database to initalize (was too lazy to write a wait-for script)
5. To run the scrapers in a docker container: docker-compose up -d scrapers. To run the scrapers on the host machine run yarn start.

View the data

You can use any mongo client and connect to the instance with the credentials specified in the .env file at localhost:2001 or run this: docker exec -it db mongo to get a mongo shell.

What is being scraped

So far, all tournaments from https://swcpoker.club, https://stockpokeronline.com, and https://roundercasino.com. Will add more.

Data

Todo: emebed screenshot