-
Notifications
You must be signed in to change notification settings - Fork 11
Open
Labels
kind/featureNew feature or requestNew feature or requestpriority/p1High priorityHigh priorityrferequest for enhancementrequest for enhancement
Milestone
Description
Motivation
Currently, Flame implements cache in a naive way: it's only using HashMap via rest api. It does not work for large data, and it's not efficient.
Function Specification
Build a dedicated object cache via Arrow Flight & Polars.
Solutions
- For build-in type, just pickle with
RunnerRequestdirectly - For normal object, put to cache after pickle
- For DataSet/DataFrame, put to cache directly
Additional context
N/A
Metadata
Metadata
Assignees
Labels
kind/featureNew feature or requestNew feature or requestpriority/p1High priorityHigh priorityrferequest for enhancementrequest for enhancement