Build a data warehouse from scratch, including full load, daily incremental load, design schema, SCD Type 1 and 2.
-
Updated
Feb 1, 2023 - Python
Build a data warehouse from scratch, including full load, daily incremental load, design schema, SCD Type 1 and 2.
A Data Warehousing project for retail sales using dimension modelling best practices with SCD type 2 on AWS Redshift. Utilizing AWS Lambda, Glue Workflows and Python Shell jobs to create and automate an ELT pipeline where batch data coming into S3 is loaded onto Redshift and necessary transformations are performed to meet requirements.
Working with SCD Type (Change Data Capture) and need a Data Vault model to test Azure Data Factory v2? - This Code with Help!
Design and implement a full ELT data pipeline using Snowflake and S3, featuring star schema modelling, SCD Type 1 & 2 handling, and incremental load automation
Add a description, image, and links to the scd-type-2 topic page so that developers can more easily learn about it.
To associate your repository with the scd-type-2 topic, visit your repo's landing page and select "manage topics."