Sync back#78

Merged

siklosid merged 237 commits intosiklosid:masterfrom

chocoapp:master

Mar 23, 2026

Commits on Sep 30, 2023

Turning follow_external_dependency into bool or dict property
siklosid
committed
Handling the new dict format of follow_external_dependency
siklosid
committed
Changing test case to see if it handles sensor parameters properly
siklosid
committed

Commits on Oct 9, 2023

Merge pull request #23 from chocoapp/feature/sensor_parameters
siklosid
authored

Commits on Oct 23, 2023

upgrade version of tenacity
claudiazi
committed

Commits on Oct 26, 2023

Merge pull request #24 from chocoapp/feature/DATA-1562-upgrade-tenacity
claudiazi
authored

Commits on Nov 15, 2023

Commits on Nov 16, 2023

Commits on Nov 17, 2023

Commits on Nov 24, 2023

Commits on Nov 30, 2023

Merge pull request #26 from chocoapp/feature/dbt-task-split
kiranvasudev
authored

Commits on Dec 4, 2023

Commits on Dec 5, 2023

Commits on Dec 7, 2023

fix: follow external dependency for staging models
kiranvasudev
committed

Commits on Dec 8, 2023

Merge pull request #30 from chocoapp/feature/dbt-task-split
kiranvasudev
authored

Commits on Feb 23, 2024

Commits on Feb 27, 2024

Merge pull request #31 from chocoapp/fix/dbt-add-core-sensor-to-int
kiranvasudev
authored

Commits on Mar 25, 2024

Turing split_statements on by default
siklosid
committed

Commits on Mar 26, 2024

Merge pull request #32 from chocoapp/feature/psql_split_statements
siklosid
authored

Commits on Apr 13, 2024

Moving to python3.9; Upgrading airflow version; removing legacy postgres operator
siklosid
committed

Commits on Apr 16, 2024

Commits on Apr 17, 2024

Commits on Apr 26, 2024

feat: register new databricks_io
claudiazi
committed
feat: refactor the DBTParseConfig to parse databricks-dbt manifest
claudiazi
committed
feat: add unit test for databricks config parser
claudiazi
committed
chore: black
claudiazi
committed
Switching to official batch operator
siklosid
committed
feat: add another param in dbt task
claudiazi
committed
Complete renaming of classes
siklosid
committed
Merge pull request #36 from chocoapp/bugfix/DATA-1804_missing_batch_logs
siklosid
authored
feat: refactor
claudiazi
committed
Merge remote-tracking branch 'origin/master' into feature/DATA-1811-databricks-io
claudiazi
committed
feat: adjust the s3 tasks
claudiazi
committed

Commits on Apr 29, 2024

feat: adjust the _get_s3_task for different dbt adapters
claudiazi
committed
fix: define the correct target_config for databricks adapter
claudiazi
committed
fix: _generate_dagger_output
claudiazi
committed
extend: command
claudiazi
committed

Commits on Apr 30, 2024

Commits on May 3, 2024

Commits on Jun 12, 2024

Commits on Jun 17, 2024

feat: adjust the dbt config parser so that view/ephemeral staging layer doesnt need a task
claudiazi
committed

Commits on Jun 18, 2024

feat: adjust io for the materalised staging model
claudiazi
committed

Commits on Jun 19, 2024

Commits on Nov 6, 2024

removed custom dbt task generation logic from Module
kiranvasudev
committed

Commits on Nov 7, 2024

Commits on Nov 8, 2024

Commits on Nov 11, 2024

update readme
kiranvasudev
committed

Commits on Nov 12, 2024

fix readme
kiranvasudev
committed

Commits on Nov 13, 2024

Merge pull request #43 from chocoapp/feature/plugin-dbt-parser
kiranvasudev
authored

Commits on Jan 7, 2025

Commits on Jan 8, 2025

Merge pull request #44 from chocoapp/feature/data-2025_reverse_etl_operator
siklosid
authored

Commits on Jan 16, 2025

feat: add application name to the spark job & add kill spark job when timeout
claudiazi
committed
fix: type of _execution_timeout
claudiazi
committed
fix: remove the wrong and uncessary function
claudiazi
committed

Commits on Jan 17, 2025

fix: timeout logic
claudiazi
committed
fix: add missing import
claudiazi
committed
fix: spark_app_name
claudiazi
committed
fix: default spark_app_name
claudiazi
committed

Commits on Jan 20, 2025

feat: improve the logic to kill the spark job
claudiazi
committed
chore: black + add log + missing function
claudiazi
committed
chore: add info to debug
claudiazi
committed
chore: add info to debug
claudiazi
committed
chore: reformat
claudiazi
committed

Commits on Jan 21, 2025

Merge pull request #45 from chocoapp/feature/DATA-2175-kill-timeout-spark
claudiazi
authored

Commits on Feb 13, 2025

Bumping tenacity version
siklosid
committed

Commits on Feb 19, 2025

Commits on Mar 18, 2025

Create soda runner
raimundovidaljunior
committed

Commits on Mar 19, 2025

Fixing configs
raimundovidaljunior
committed

Commits on Mar 24, 2025

Remove unnecessary vars
raimundovidaljunior
committed

Commits on Mar 25, 2025

Merge pull request #49 from chocoapp/feature/DATA-2216-create-soda-runner
raimundovidaljunior
authored

Commits on Mar 28, 2025

Adding column mapping and case conversion
raimundovidaljunior
committed

Commits on Apr 1, 2025

Commits on Apr 7, 2025

Merge pull request #50 from chocoapp/feature/DATA-2232-Turn-on-reverse-ETL-for-sendgrid-data
raimundovidaljunior
authored

Commits on Apr 15, 2025

Commits on Apr 22, 2025

feat: add param _columns_to_include and _columns_to_exclude in the reverse_etl task
claudiazi
committed

Commits on Apr 23, 2025

Commits on Apr 25, 2025

Commits on Apr 28, 2025

Commits on May 13, 2025

Merge pull request #54 from chocoapp/feature/DATA-2238-Add-critical-test-flag
raimundovidaljunior
authored

Commits on Jun 4, 2025

feat: new param for s3 destination
claudiazi
committed
feat: add region_name for s3 io
claudiazi
committed

Commits on Jun 5, 2025

feat: make batch_size and num_threads optional
claudiazi
committed

Commits on Jun 10, 2025

Merge pull request #55 from chocoapp/feature/DATA-2281-reverse-etl-new-params
claudiazi
authored

Commits on Jun 18, 2025

feat: convert soda to deferrable
claudiazi
committed
Merge remote-tracking branch 'origin/master' into feature/DATA-2275-adjsut-soda-to-deferrable
claudiazi
committed

Commits on Jun 19, 2025

feat: convert soda to deferrable
claudiazi
committed
feat: convert soda to deferrable
claudiazi
committed
fix: add extra package
claudiazi
committed

Commits on Jun 24, 2025

Commits on Jul 16, 2025

Commits on Aug 7, 2025

Commits on Aug 8, 2025

feat: fetch the logs from cloudwatch before BatchOperator.execute_complete
claudiazi
committed
feat: add fetch logs if the execute fails
claudiazi
committed
Merge remote-tracking branch 'origin/feature/DATA-2449-improve-failed-deferrable-batch' into feature/DATA-2449-improve-failed-deferrable-batch
claudiazi
committed
fix: handle all failure scenarios
claudiazi
committed
fix: overwrite resume_execution
claudiazi
committed
fix: save job_id in xcom
claudiazi
committed
chore: simplify the logic
claudiazi
committed
chore: clean the logic
claudiazi
committed
Merge pull request #61 from chocoapp/feature/DATA-2449-improve-failed-deferrable-batch
claudiazi
authored

Commits on Oct 19, 2025

Relaxing click version to avoid conflict with dbt
siklosid
committed

Commits on Oct 30, 2025

Merge pull request #62 from chocoapp/feature/DATA-2528_relaxing_click_version
siklosid
authored

Commits on Nov 4, 2025

Merge pull request #63 from chocoapp/feature/DATA-2563_python_upgrade_dagger
siklosid
authored

Commits on Jan 9, 2026

Commits on Jan 15, 2026

Commits on Feb 12, 2026