Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
91 commits
Select commit Hold shift + click to select a range
20ef271
Uploading Michael's notebook before testing
validbeck Mar 10, 2025
eb3ada7
+ champion model file & moved draft to tutorials
validbeck Mar 10, 2025
17b5da8
111 draft
validbeck Mar 11, 2025
bc4e985
111 notes
validbeck Mar 11, 2025
29a6a07
111 adjusting
validbeck Mar 11, 2025
2ab9c26
111 +intro
validbeck Mar 11, 2025
c7fcb9e
111 + intro
validbeck Mar 11, 2025
653c22d
Merge 'main' into beck/sc-9082/edit-validation-credit-risk-notebook
validbeck Mar 11, 2025
d942bdf
102 accidentally deleted a header somehow
validbeck Mar 11, 2025
5115202
111 new draft
validbeck Mar 12, 2025
fbab0ee
111 editing intro to be validator-focused
validbeck Mar 12, 2025
a9e1ddf
Edited the About ValidMind section to be more role agnostic
validbeck Mar 12, 2025
a1568c0
Missed one
validbeck Mar 12, 2025
26ed550
111 +Register a sample model
validbeck Mar 12, 2025
4416aa0
111 +Getting to know ValidMind
validbeck Mar 12, 2025
1dc92cf
111 Set up for Import the champion model
validbeck Mar 12, 2025
a8b6ff9
111 Shuffling things around
validbeck Mar 12, 2025
a6446a8
111 Importing the champion model done?
validbeck Mar 12, 2025
2794c90
111 Setup for custom context
validbeck Mar 12, 2025
b9c9c99
Moving LLM context stuff, changed my mind
validbeck Mar 12, 2025
0b1fe9f
111 Added section on finding the validation report in the platform
validbeck Mar 12, 2025
c988e68
111 +ToC
validbeck Mar 12, 2025
4b5f318
112 setup
validbeck Mar 12, 2025
9cd9f70
112 copied info over
validbeck Mar 12, 2025
1de2f5d
111 more context
validbeck Mar 12, 2025
357ff98
112 Setup for challenger models
validbeck Mar 12, 2025
94bb706
112 Challenger models v1
validbeck Mar 12, 2025
f755e51
112 Setup for custom context
validbeck Mar 13, 2025
a8a5dc8
Changed dataset for custom context
validbeck Mar 13, 2025
4fb7c24
113 setup
validbeck Mar 13, 2025
fcab3f4
112 ToC
validbeck Mar 13, 2025
64cb7f3
113 title adjust
validbeck Mar 13, 2025
4020911
114 setup
validbeck Mar 13, 2025
699985a
113 Prereqs
validbeck Mar 13, 2025
ef87a7c
113 Setting up
validbeck Mar 13, 2025
1f6beef
113 Setting up edit
validbeck Mar 13, 2025
c4fe040
113 Setting up edit2
validbeck Mar 13, 2025
6711d08
113 Setting up edit3
validbeck Mar 13, 2025
f15fa91
113 Setting up edit4
validbeck Mar 13, 2025
42a2b8a
113 Set up for Identify qualitative tests
validbeck Mar 13, 2025
a169b4a
113 Identify qualitative tests editing
validbeck Mar 13, 2025
7450f3a
113 Run performance tests draft
validbeck Mar 13, 2025
921cf1f
113 warning about missing text-driven blocks
validbeck Mar 13, 2025
8afd370
113 Evaluate performance of challengers WIP
validbeck Mar 13, 2025
d59c3a3
113 Wrapping up
validbeck Mar 13, 2025
071ce0d
114 prereq
validbeck Mar 13, 2025
ffb887b
114 transfered rest of code over
validbeck Mar 13, 2025
4b71f67
114 transfered rest of code over edit
validbeck Mar 13, 2025
3a88f6b
114 cleanup wip
validbeck Mar 13, 2025
32542ac
114 cleanup wip2
validbeck Mar 13, 2025
ce256f9
114 cleanup wip3
validbeck Mar 13, 2025
9a690ec
114 Adjust a comparison test
validbeck Mar 13, 2025
b51eee7
114 Next steps draft
validbeck Mar 13, 2025
6c6e59f
114 quick code cleanup
validbeck Mar 13, 2025
9f1e8d5
114 Run diagnostic tests done
validbeck Mar 14, 2025
63beecf
Implement a custom test done
validbeck Mar 14, 2025
871eabe
114 Verify test runs done
validbeck Mar 14, 2025
8ff1773
In summary done
validbeck Mar 14, 2025
664591b
114 Add test results to reporting draft
validbeck Mar 14, 2025
1d96685
114 Finishing up
validbeck Mar 14, 2025
8515248
LLM custom context - session info
validbeck Mar 14, 2025
2dd03e2
114 quick edit to summary
validbeck Mar 14, 2025
d4b1f1b
Removing the old notebook
validbeck Mar 14, 2025
09a348b
Tweak
validbeck Mar 14, 2025
0db6921
Tweak2
validbeck Mar 14, 2025
584b1fc
Typo
validbeck Mar 14, 2025
6eb3eb1
Comment on .gitignore
validbeck Mar 14, 2025
6034dd3
Updating the old intro notebook just in case someone finds it
validbeck Mar 25, 2025
5dcfa66
Edits to validation key concepts + dataset transformations
validbeck Mar 26, 2025
a424832
Removing test suites as well
validbeck Mar 26, 2025
2ed90a3
Tweak
validbeck Mar 26, 2025
92749df
Setup for advanced notebook
validbeck Mar 27, 2025
037faf4
Moving the application scorecard advanced notebook
validbeck Mar 27, 2025
e41066c
Moving 111 to new notebook
validbeck Mar 27, 2025
f7889ee
Moving 112 to new notebook
validbeck Mar 27, 2025
5b6e7ef
Moving 113 to new notebook
validbeck Mar 27, 2025
ebbc3a1
Moving 114 to new notebook
validbeck Mar 27, 2025
f81c9ae
Moving the champion model
validbeck Mar 27, 2025
649dff1
Shifting use case stuff around take 1
validbeck Mar 27, 2025
1b0a78a
Moving more stuff around
validbeck Mar 27, 2025
0224c69
Adding individual tests
validbeck Mar 27, 2025
cd4e766
Editing
validbeck Mar 27, 2025
53fad6b
More editing
validbeck Mar 27, 2025
a5bc2c8
Adding ToC
validbeck Mar 27, 2025
c9ad497
Ugh
validbeck Mar 27, 2025
9295b73
Cleaning up the What's next section
validbeck Mar 28, 2025
b023a40
Removing the tests causing issues
validbeck Mar 28, 2025
72596a0
Final edits?
validbeck Mar 28, 2025
250da62
xgb_model > xgb_model_developer_champion
validbeck Mar 28, 2025
7162288
Moving the introductory notebooks to own PR
validbeck Mar 28, 2025
e75347a
2.8.14
validbeck Mar 28, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -191,6 +191,8 @@ lending_club_loan_data_*.csv

# Pickle files
*.pkl
# Sample application scorecard model for validation notebook — do not remove!
!notebooks/code_samples/model_validation/xgb_model_champion.pkl

notebooks/llm/datasets/*.jsonl

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,7 @@
"\n",
"### New to ValidMind?\n",
"\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #f7e4ee; color: black; border: 1px solid black;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@
"\n",
"### New to ValidMind?\n",
"\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #f7e4ee; color: black; border: 1px solid black;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@
"<a id='toc1_2_'></a>\n",
"\n",
"### New to ValidMind?\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #B5B5B510; color: black; border: 1px solid #083E44; border-left-width: 5px; box-shadow: 2px 2px 4px rgba(0, 0, 0, 0.2);border-radius: 5px;\"><span style=\"color: #083E44;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b></span>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@
"<a id='toc1_2_'></a>\n",
"\n",
"### New to ValidMind?\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #B5B5B510; color: black; border: 1px solid #083E44; border-left-width: 5px; box-shadow: 2px 2px 4px rgba(0, 0, 0, 0.2);border-radius: 5px;\"><span style=\"color: #083E44;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b></span>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@
"<a id='toc1_2_'></a>\n",
"\n",
"### New to ValidMind?\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #B5B5B510; color: black; border: 1px solid #083E44; border-left-width: 5px; box-shadow: 2px 2px 4px rgba(0, 0, 0, 0.2);border-radius: 5px;\"><span style=\"color: #083E44;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b></span>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@
"<a id='toc1_2_'></a>\n",
"\n",
"### New to ValidMind?\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n"
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n"
]
},
{
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@
"<a id='toc1_2_'></a>\n",
"\n",
"### New to ValidMind?\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #B5B5B510; color: black; border: 1px solid #083E44; border-left-width: 5px; box-shadow: 2px 2px 4px rgba(0, 0, 0, 0.2);border-radius: 5px;\"><span style=\"color: #083E44;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b></span>\n",
"<br></br>\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@
"\n",
"### New to ValidMind?\n",
"\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models, find code samples, or read our developer reference.\n",
"If you haven't already seen our documentation on the [ValidMind Library](https://docs.validmind.ai/developer/validmind-library.html), we recommend you begin by exploring the available resources in this section. There, you can learn more about documenting models and running tests, as well as find code samples and our Python Library API reference.\n",
"\n",
"<div class=\"alert alert-block alert-info\" style=\"background-color: #B5B5B510; color: black; border: 1px solid #083E44; border-left-width: 5px; box-shadow: 2px 2px 4px rgba(0, 0, 0, 0.2);border-radius: 5px;\"><span style=\"color: #083E44;\"><b>For access to all features available in this notebook, create a free ValidMind account.</b></span>\n",
"<br></br>\n",
Expand Down
Loading