A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset
-
Updated
Nov 9, 2024 - Dockerfile
#
mage-ai
Here are 29 public repositories matching this topic...
Project MLOps
flask aws streaming monitoring mongodb model grafana orchestration batch-processing prefect mlops mlflow mage-ai
-
Updated
Sep 28, 2024 - Jupyter Notebook
An end-to-end data engineering pipeline that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python bigquery data automation cloud sql database docker-compose virtual-machine excel gcp mariadb orchestration data-engineering maintenance database-schema compute-engine work-orders visualization-dashboard mage-ai
-
Updated
Dec 14, 2024 - Jupyter Notebook
End-to-end data engineering project
-
Updated
Jul 19, 2023 - Jupyter Notebook
Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio
-
Updated
Sep 19, 2023 - Jupyter Notebook
A data engineering project built around Smogon's Stats API.
-
Updated
Nov 21, 2024 - Python
Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.
python docker workflow data-science database etl docker-compose orchestration datascience data-engineering data-analysis etl-pipeline de-zoomcamp mage-ai
-
Updated
Mar 4, 2024 - Jupyter Notebook
Docker image for Mage AI deployment using Docker
-
Updated
Dec 23, 2024 - Dockerfile
-
Updated
Jan 8, 2024 - Python
mlops zoomcamp capstone project
-
Updated
Jun 25, 2024 - Jupyter Notebook
In this project, I demonstrate creating a data pipeline from NYC Taxi data using Mage.ai for ETL, GCP for storage and BigQuery, and Looker Studio for analytics.
-
Updated
Oct 4, 2024
Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.
-
Updated
Oct 5, 2023 - Jupyter Notebook
An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.
-
Updated
Aug 12, 2023 - Jupyter Notebook
Personal project for Data Engineering Zoomcamp
-
Updated
Apr 13, 2024 - Jupyter Notebook
The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.
data-storage data-engineering cloud-computing public-data data-processing data-pipeline amazon-s3 etl-pipeline script-automation mage-ai cnpj-data
-
Updated
Sep 1, 2024 - Python
Engineered a robust data pipeline using Google Cloud Platform (GCP) services like Cloud Storage, Compute Engine, BigQuery, resulting in a 30% decrease in data processing and analysis time of the San Francisco Crime dataset.Designed an interactive dashboard using Looker Studio, empowering stakeholders to explore crime data visually.
-
Updated
Sep 21, 2023 - Jupyter Notebook
Data Engineering Pipeline for Uber Data Analysis using Google Cloud Platform, Mage-AI and Looker
-
Updated
Feb 23, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the mage-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mage-ai topic, visit your repo's landing page and select "manage topics."