Skip to content

Core + simple cache API#85

Merged
zkat merged 8 commits intomainfrom
sy/core-cache
Mar 16, 2026
Merged

Core + simple cache API#85
zkat merged 8 commits intomainfrom
sy/core-cache

Conversation

@TartanLlama
Copy link
Copy Markdown
Collaborator

Implements the Core Cache API, based on the Rust implementation, but calling hostcalls directly.

Most of this is a fairly mechanical translation from the Rust SDK. The tricky part is where the existing Rust types (StreamingBody) are required, in which case we need to retrieve handles from host calls, then pass those through Rust and get back a C++-wrapped Rust object to return to the user. This is a pattern we'll have to do elsewhere if we decide to piecemeal move away from wrapping the Rust SDK and prefer making hostcalls ourselves.

This is currently lacking any testing: I haven't even tried to load it into Viceroy.

@TartanLlama TartanLlama marked this pull request as ready for review March 16, 2026 11:22
@TartanLlama TartanLlama changed the title Core cache API Core + simple cache API Mar 16, 2026
@zkat zkat merged commit 57984bc into main Mar 16, 2026
6 checks passed
@zkat zkat deleted the sy/core-cache branch March 16, 2026 19:15
@zkat zkat added the feature New feature or request label Mar 16, 2026
@shukitchan
Copy link
Copy Markdown

It will be nice to add examples for these new APIs.
The tests are good for understanding them, too.
Also is the documentation going to be auto-updated as well?
Finally I assume a new release will include this and the rate limit api soon?

@TartanLlama TartanLlama mentioned this pull request Mar 30, 2026
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants