Skip to content
Merged

Dev #42

Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions DESCRIPTION
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
Package: EndpointR
Title: Connects to various Machine Learning inference providers
Version: 0.2.1
Version: 0.2.2
Authors@R: c(
person("Jack", "Penzer", , "Jack.penzer@sharecreative.com", role = c("aut", "cre")),
person("Jack", "Penzer", , "jack.penzer@samy.com", role = c("aut", "cre")),
person("Ben", "Jessup", , "ben.jessup@samy.com", role = "aut"),
person("Claude", "AI", role = "aut")
)
Description: EndpointR is a 'batteries included', open-source R package for connecting to various APIs for Machine Learning model predictions. EndpointR is built for company-specific use cases, so may not be useful to a wide audience.
Expand Down
5 changes: 5 additions & 0 deletions NAMESPACE
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
# Generated by roxygen2: do not edit by hand

export(ant_batch_cancel)
export(ant_batch_create)
export(ant_batch_list)
export(ant_batch_results)
export(ant_batch_status)
export(ant_build_messages_request)
export(ant_complete_chunks)
export(ant_complete_df)
Expand Down
20 changes: 20 additions & 0 deletions NEWS.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,23 @@
# EndpointR (dev)

# EndpointR 0.2.2

## Anthropic Messages API
- `ant_build_messages_request()` now automatically enables prompt caching when a `system_prompt` is provided, structuring it as a content block with `cache_control`. This benefits `ant_complete_chunks()` and `ant_complete_df()` where many requests share the same system prompt — cached reads cost 90% less than uncached.
- Structured outputs is out of BETA and is now generally available, so the header is removed, and `output_form` --> `output_config` in the body of the request following [Anthropic Docs on Structured Outputs](https://platform.claude.com/docs/en/build-with-claude/structured-outputs)

## Anthropic Batch API

Functions for dealing with Anthropic Bathches API, works differently ot the OpenAI API - as we send requests not files.

- `ant_batch_create()`
- `ant_batch_status()`
- `ant_batch_results()`
- `ant_batch_list()`
- `ant_batch_cancel()`

See the [Sync Async Vignette](articles/sync_async.html#anthropic-message-batches-api) for more details

# EndpointR 0.2.1

## OpenAI Batch API
Expand Down
Loading