Skip to content

Single ZK node fate data #4905

@kevinrr888

Description

@kevinrr888

Is your feature request related to a problem? Please describe.
For MetaFateStore, it would be beneficial to have all the data associated with a fate id in a single ZooKeeper node. This allows for atomic updates to a fate id. This will be slower than the current implementation. We are trading some speed for correctness. However, since this is only used for the tables in the accumulo namespace (ROOT, METADATA, FATE, SCAN_REF), this is a good tradeoff. In previous versions (before 4.x), MetaFateStore (aka ZooStore) was used for all transactions, so this change wasn't practical. With this change, it would also be nice to serialize the data as JSON allowing for easier serialization and deserialization and for better readability.

Additional context
#4524 (comment)
#4524 (comment)

Metadata

Metadata

Assignees

Labels

enhancementThis issue describes a new feature, improvement, or optimization.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions