You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/06-general-guides/04-ai-evals.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,27 +25,27 @@ The Discourse AI plugin ships a Ruby CLI under `plugins/discourse-ai/evals` that
25
25
-`OPENAI_API_KEY=...`
26
26
-`ANTHROPIC_API_KEY=...`
27
27
-`GEMINI_API_KEY=...`
28
-
- From the repository root, change into `plugins/discourse-ai/evals` and run `./run --help` to confirm the CLI is wired up. If `evals/cases` is missing it will be cloned automatically from `discourse/discourse-ai-evals`.
28
+
- From the repository root, change into `plugins/discourse-ai/evals` and run `bundle exec ruby ./run --help` to confirm the CLI is wired up. If `evals/cases` is missing it will be cloned automatically from `discourse/discourse-ai-evals`.
29
29
30
30
## Discover available inputs
31
31
32
-
-`./run --list` lists all eval ids from `evals/cases/*/*.yml`.
33
-
-`./run --list-features` prints feature keys grouped by module (format: `module:feature`).
34
-
-`./run --list-models` shows LLM configs that can be hydrated from `eval-llms.yml`/`.local.yml`.
35
-
-`./run --list-personas` lists persona keys defined under `evals/personas/*.yml` plus the built-in `default`.
32
+
-`bundle exec ruby ./run --list` lists all eval ids from `evals/cases/*/*.yml`.
33
+
-`bundle exec ruby ./run --list-features` prints feature keys grouped by module (format: `module:feature`).
34
+
-`bundle exec ruby ./run --list-models` shows LLM configs that can be hydrated from `eval-llms.yml`/`.local.yml`.
35
+
-`bundle exec ruby ./run --list-personas` lists persona keys defined under `evals/personas/*.yml` plus the built-in `default`.
0 commit comments