Skip to content

feat: Bump to latest SDK version with Python 3.9 support#2

Merged
ReubenFrankel merged 4 commits intomainfrom
feat/upgrade-sdk
Feb 10, 2026
Merged

feat: Bump to latest SDK version with Python 3.9 support#2
ReubenFrankel merged 4 commits intomainfrom
feat/upgrade-sdk

Conversation

@ReubenFrankel
Copy link

Necessary to resolve error

ModuleNotFoundError: No module named 'pkg_resources'

caused by a new release of setuptools (v82.0.0) as an indirect unpinned dependency of an older SDK version.

@ReubenFrankel ReubenFrankel self-assigned this Feb 9, 2026
@ReubenFrankel ReubenFrankel added the enhancement New feature or request label Feb 9, 2026
@ReubenFrankel
Copy link
Author

@edgarrmondragon Wondered if you knew of any better way other than re-adding the previous SDK discovery_catalog_entries implementation to ensure the logic currently sitting in get_object_names is applied, since these are now both deprecated methods?

This is particularly important:

        # Bigquery inspections returns table names in the form
        # `schema_name.table_name` which later results in the project name
        # override due to specifics in behavior of sqlalchemy-bigquery
        #
        # Let's strip `schema_name` prefix on the inspection

@edgarrmondragon
Copy link

@edgarrmondragon Wondered if you knew of any better way other than re-adding the previous SDK discovery_catalog_entries implementation to ensure the logic currently sitting in get_object_names is applied, since these are now both deprecated methods?

This is particularly important:

        # Bigquery inspections returns table names in the form
        # `schema_name.table_name` which later results in the project name
        # override due to specifics in behavior of sqlalchemy-bigquery
        #
        # Let's strip `schema_name` prefix on the inspection

😕 not really, since the new implementation does significantly more than get_object_names(). It'd be good to explore what the methods used in the new discover_catalog_entries() return for bigquery, and also offer an SDK API for the two operations taking place in this implementation:

  1. process tables names returned by the inspection result
  2. filter tables

@ReubenFrankel
Copy link
Author

Yeah, I spent a fair chunk of time trying to get it to work, but no dice. I actually started seeing the same error from MeltanoLabs#34 initially, so perhaps my comment on there was not entirely correct and/or there is some specific version incompatibility between singer-sdk and sqlalchemy-bigquery that causes it to break.

Thanks!

@ReubenFrankel ReubenFrankel merged commit 0fe86bc into main Feb 10, 2026
7 checks passed
@ReubenFrankel ReubenFrankel deleted the feat/upgrade-sdk branch February 10, 2026 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants