Skip to content

Adding latest RawData notebook to docs#647

Merged
validbeck merged 3 commits intomainfrom
beck/sc-8282/documentation-add-raw-data-to-validmind-library
Feb 5, 2025
Merged

Adding latest RawData notebook to docs#647
validbeck merged 3 commits intomainfrom
beck/sc-8282/documentation-add-raw-data-to-validmind-library

Conversation

@validbeck
Copy link
Collaborator

@validbeck validbeck commented Feb 5, 2025

Internal Notes for Reviewers

sc-8282

Follow up to validmind/validmind-library#309.

Pulled in the latest RawData notebook and added mentions it to on the following pages:

Testing overview

LIVE PREVIEW

Screenshot 2025-02-05 at 9 37 02 AM

FAQ - Testing

LIVE PREVIEW

Screenshot 2025-02-05 at 9 36 31 AM

@validbeck validbeck added the internal Not to be externalized in the release notes label Feb 5, 2025
@validbeck validbeck self-assigned this Feb 5, 2025
@validbeck
Copy link
Collaborator Author

@johnwalz97 Just pullin' in the notebook you spun up into the docs. Let me know if anything else needs to be added or if it's g2g! 🙏🏻

@github-actions
Copy link
Contributor

github-actions bot commented Feb 5, 2025

PR Summary

This pull request introduces enhancements to the testing documentation by adding a new feature, RawData, to the ValidMind tests. The RawData feature allows users to access intermediate or unprocessed data generated during test execution, enabling customization of test outputs. The changes include:

  • Documentation Updates:

    • Added a new entry in the testing-overview.qmd file to include a new notebook understand_utilize_rawdata.ipynb.
    • Updated the FAQ section in faq-testing.qmd to include information about the RawData feature and its benefits for customizing test outputs.
  • New Notebook:

    • Introduced a new Jupyter notebook understand_utilize_rawdata.ipynb that provides a comprehensive guide on how to use the RawData feature in ValidMind tests. This notebook includes examples of using RawData for ROC Curve, Pearson Correlation Matrix, and Precision-Recall Curve tests, as well as creating custom tests that utilize RawData.

These changes aim to enhance the flexibility and usability of the ValidMind testing framework by allowing users to tailor test outputs to their specific needs.

Test Suggestions

  • Verify that the new notebook understand_utilize_rawdata.ipynb runs without errors and produces the expected outputs.
  • Test the integration of the RawData feature with existing ValidMind tests to ensure compatibility.
  • Check the documentation links and references in the updated FAQ and testing overview files for accuracy.
  • Ensure that the examples provided in the new notebook are clear and reproducible.
  • Test the custom test creation process using RawData as described in the notebook.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 5, 2025

PR Summary

This pull request introduces enhancements to the testing documentation by adding a new feature called RawData in the ValidMind tests. The changes include:

  1. Documentation Updates:

    • Updated the testing-overview.qmd file to include a new grid column and an additional content entry for understanding and utilizing RawData.
    • Enhanced the FAQ section in faq-testing.qmd to include information about personalizing tests using the RawData feature.
  2. New Notebook:

    • Added a new Jupyter notebook understand_utilize_rawdata.ipynb that provides a comprehensive guide on how to access, inspect, and utilize RawData in ValidMind tests. This notebook includes setup instructions, usage examples, and custom test creation using RawData.

These changes aim to improve the flexibility and customization of test outputs by leveraging the RawData feature, allowing users to create custom visualizations and post-processing functions.

Test Suggestions

  • Verify that the new grid column in testing-overview.qmd displays correctly.
  • Check that the new content entry in testing-overview.qmd links to the correct notebook.
  • Ensure that the FAQ section in faq-testing.qmd correctly describes the RawData feature.
  • Run the new Jupyter notebook understand_utilize_rawdata.ipynb to ensure all code cells execute without errors.
  • Test the examples in the notebook to confirm that RawData is being utilized as described.
  • Validate that custom tests using RawData can be created and executed successfully.

Copy link
Contributor

@johnwalz97 johnwalz97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm @validbeck

@validbeck validbeck merged commit ffabf52 into main Feb 5, 2025
6 of 7 checks passed
@validbeck validbeck deleted the beck/sc-8282/documentation-add-raw-data-to-validmind-library branch February 5, 2025 19:34
nrichers added a commit that referenced this pull request Feb 14, 2025
* Adding latest `RawData` notebook to docs (#647)

* Pulling in latest RawData notebook

* Added notebook to testing overview

* Added notebook to FAQ - testing

* feat: make lighter version of docs-site target

* Fix notebook link (#651)

* Part 1 — +"Breaking changes and deprecation" page under releases to support the new processes (#650)

* Adding a breaking changes page

* Details

* Editing headers

* Adding product area

* Folder

* Testing R table

* It woooorks

* Setup for multiple entires & adding search back

* Adjusting test data for clarity

* Single-sourcing the functions

* Moving functions to scri[pt for cleaner exp

* Column widths back in

* Cleanup & templates

* Templating README

* Tweaking

* Adding version and type columns

* Filters for version & type

* Examples and more testing

* Intro to README

* Moved history into its own folder

* Instructions for +year

* Add an entry draft

* Entry example table

* Testing R setup

* Switching placement

* Forgot a package

* Cleanup & caching

* Forgot a package again

* Adding R env to staging & prod flows

* Naming the code cells for output cleanliness

* Removed fake 2025 example

* Wow, typo

* Wording adjustment

* Removed blog posts

* Fix notebook link (#651) (#654)

Co-authored-by: Nik Richers <nik@validmind.ai>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Define next iteration of training content (#649)

* Rough in some topics

* WIP content noodling

* Fix merge conflict

* Content rework

* Content edits

* Add mapping from questions to courses

* Content edits

* Updated content, move videos

* Update learning paths

* Update learning paths

* Expand learning paths

* Update learning paths, FAQ

* Edits

* Update course content

* Update FAQ

* Fix margin callout, shorten sample training plan

* Minor edits

* Add docs links to FAQ

* Update FAQ and learning paths

* Training FAQ updates

* Clean up temporary CSS, add small button CSS

* Hide .attn sections to be able to publish the page

* Update FAQ page formatting, add Pandas link

* Add some FAQ-elements

* Best offer for formatting an shenanigans

* Hide more working notes stuff, add .attn to learning path course cards

* More learning paths formatting improvements

* Simplify language and remove old file

* Add callouts to learning paths

* Modifying some style stuff

* Redoing buttons for readability

* Quick tweak to sidebar

* Overview rename & cleanup

* Reverting sidebar & toc for rest of site

* Update site/training/program/sample-training-plan.qmd

Co-authored-by: Beck <164545837+validbeck@users.noreply.github.com>

* Training sidebar tweaks

* Remove extra newline and commented out line

* Improve 'coming soon' text

---------

Co-authored-by: Beck <164545837+validbeck@users.noreply.github.com>

---------

Co-authored-by: Beck <164545837+validbeck@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Spencer Krum <nibz@validmind.ai>
Co-authored-by: Spencer Krum <nibz@spencerkrum.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

internal Not to be externalized in the release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants