-
Notifications
You must be signed in to change notification settings - Fork 478
Description
Is your feature request related to a problem? Please describe.
For MetaFateStore, it would be beneficial to have all the data associated with a fate id in a single ZooKeeper node. This allows for atomic updates to a fate id. This will be slower than the current implementation. We are trading some speed for correctness. However, since this is only used for the tables in the accumulo namespace (ROOT, METADATA, FATE, SCAN_REF), this is a good tradeoff. In previous versions (before 4.x), MetaFateStore (aka ZooStore) was used for all transactions, so this change wasn't practical. With this change, it would also be nice to serialize the data as JSON allowing for easier serialization and deserialization and for better readability.
Additional context
#4524 (comment)
#4524 (comment)