Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion site/developer/model-testing/testing-overview.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ aliases:
listing:
- id: tests-beginner
type: grid
grid-columns: 2
max-description-length: 250
sort: false
fields: [title, description]
Expand All @@ -28,7 +29,7 @@ listing:
max-description-length: 250
sort: false
fields: [title, description]
contents:
contents:
- ../../notebooks/code_samples/custom_tests/integrate_external_test_providers.ipynb
- ../../notebooks/how_to/configure_dataset_features.ipynb
- ../../notebooks/how_to/run_documentation_sections.ipynb
Expand All @@ -43,6 +44,7 @@ listing:
contents:
- ../../notebooks/how_to/document_multiple_results_for_the_same_test.ipynb
- ../../notebooks/how_to/load_datasets_predictions.ipynb
- ../../notebooks/how_to/understand_utilize_rawdata.ipynb
- id: tests-custom
type: grid
max-description-length: 250
Expand Down
8 changes: 5 additions & 3 deletions site/faq/faq-testing.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -37,10 +37,10 @@ Yes, {{< var vm.product >}} allows tests to be manipulated at several levels:
- You can configure which tests are required to run programmatically depending on the model use case.[^4]
- You can change the thresholds and parameters for default tests already available in the {{< var vm.developer >}} — for instance, changing the threshold parameter for the class imbalance flag.[^5]
- You can also connect your own custom tests with the {{< var validmind.developer >}}. These custom tests are configurable and are able to run programmatically, just like the rest of the {{< var vm.developer >}}.[^6]
- Personalize tests further for your use case by using {{< var vm.product >}}'s `RawData` feature[^7] to customize the output of tests.

::: {.callout}
In addition to custom tests, you can also add use case and test-specific context for any test to enhance the LLM-generated test descriptions using the {{< var validmind.developer >}}.[^7]

In addition to custom tests, you can also add use case and test-specific context for any test to enhance the LLM-generated test descriptions using the {{< var validmind.developer >}}.[^8]
:::

{{< include _faq-explainability.qmd >}}
Expand Down Expand Up @@ -69,4 +69,6 @@ In addition to custom tests, you can also add use case and test-specific context

[^6]: [Can I use my own tests?](/developer/model-testing/testing-overview.qmd#can-i-use-my-own-tests)

[^7]: [Add context to LLM-generated test descriptions](/notebooks/how_to/add_context_to_llm_descriptions.ipynb)
[^7]: [Understand and utilize `RawData` in {{< var vm.product >}} tests](/notebooks/how_to/understand_utilize_rawdata.ipynb)

[^8]: [Add context to LLM-generated test descriptions](/notebooks/how_to/add_context_to_llm_descriptions.ipynb)
Binary file modified site/notebooks.zip
Binary file not shown.
Loading
Loading