Smogboard v1

An end-to-end data engineering project using data sources from Smogon Stats and PokeAPI.

[UPDATE] Dashboard will no longer be functional after Jan 2024, I ran out of GCP credits and was charged $100 by Google :(

🧑‍🔧 Data Pipeline

• Mage was in charge of my ETL processes and scheduling/orchestration because people were hyping it as the next Airflow.
• BigQuery handled my Data Warehousing needs and it was effortless connecting it to Looker Studio as a live source.
• Yes it's nothing fancy, but hey - it works.

🌟 Data Model

• I used Kimball's approach for data warehousing (transaction-based) and created the star schema below.
• Again, nothing fancy because I didn't want to overcomplicate this project.

🚀 Demo

• The final result (yes it needs some work):

Click here to interact with it! (Dashboard no longer functional due to lack of credits)

💻 Built With

Technologies used in the project:

• Python
• Mage
• Google Cloud Platform
• BigQuery
• Looker Studio

👀 What's Next

• Including statistics for other generations and battle formats
• Improve on the dashboard's design and naming consistency of fields
• Enhance dashboard visuals with sprites and type-based coloring
• Add staging via Cloud Storage

🛡️ License

This project is licensed under the MIT License.