[Feature]: Support filtering commit log by Iceberg Content field's snapshotId in CEL expressions in V2 API #11767
Description
Description
We were exploring filtering the commit logs based on snapshotId for a use case where we want to identify table creation event in a branch history.
Table creation event is marked by snapshotId : -1. However scope of the operations filter is limited to top-level fields like type and key.
Expected Use Cases
- identify table creation event we need to ingest the commit log for a table filtered response at client side and then filter for snapshotId, resulting in additional client side processing, especially for tables with larger commit history.
Requested Changes in public API
- Extending the CEL filters to support snapshotId, something like this -
operations.exists(op, op.keyElements == [<db-name>, <table-id>] && op.content.snapshotId == -1)