End-to-end Azure data engineering pipeline ingesting real-time earthquake data from the USGS API. Implements a Bronze–Silver–Gold lakehouse using Azure Data Factory, Databricks, ADLS Gen2, and Synapse Analytics, with both manual execution and fully automated daily-triggered workflows.
big-data azure scheduled-jobs power-bi pyspark data-engineering earthquake-data usgs-api azure-data-factory etl-pipeline azure-databricks lakehouse azure-sql-management cloud-data-platform api-integrations medallion-architecture pipeline-orchestration microsoft-fabric adls-gen2 azure-syn
-
Updated
Dec 22, 2025 - Jupyter Notebook