Skip to content

feat(training): update evals API & example notebooks#49

Open
bartolomej wants to merge 3 commits intofeat/military-strikes-notebookfrom
bart/updated-millitary-strikes-notebook
Open

feat(training): update evals API & example notebooks#49
bartolomej wants to merge 3 commits intofeat/military-strikes-notebookfrom
bart/updated-millitary-strikes-notebook

Conversation

@bartolomej
Copy link
Copy Markdown
Collaborator

@bartolomej bartolomej commented Mar 27, 2026

The updated evals API supports:

  • running evals on any number of models
  • running evals against intermediate training checkpoints (exposed via TrainingJob.model_id_by_step)

Depends on https://app.graphite.com/github/pr/lightning-rod-labs/llm_forecasting/1122

Copy link
Copy Markdown
Collaborator Author

bartolomej commented Mar 27, 2026

@bartolomej bartolomej changed the title update api client feat(training): update evals API & example notebooks Mar 27, 2026
@bartolomej bartolomej marked this pull request as ready for review March 27, 2026 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant