Pinned Loading

1. Mini-Dynamo-KV-Store Mini-Dynamo-KV-Store Public

   The objective is to build a portfolio-grade distributed database system that demonstrates real-world distributed-systems design and operations. The system will provide a highly available, horizonta…

   Go

2. Automated-Exploratory-Data-Analysis Automated-Exploratory-Data-Analysis Public

   Helps data analyst and data scientist by automating exploratory data analysis part and to gather insights from data quickly

   Python

3. Data-Pipeline-for-RSS-Feeds Data-Pipeline-for-RSS-Feeds Public

   End to End data engineering project.

   Python

4. Modern-Data-Engineering-Lakehouse Modern-Data-Engineering-Lakehouse Public

   In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our cloud provider.

5. Reddit-Data-Engineering Reddit-Data-Engineering Public

   This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. The pipeline leverages a combination of tools and serv…

   Python

6. Transaction-CDC-Streaming Transaction-CDC-Streaming Public

   This project demonstrates the implementation of a Change Data Capture (CDC) system using Debezium, Kafka, Postgres, and Docker.

   Python