Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
b7d65cb
Setup for new validator training
validbeck May 2, 2025
7c763eb
Save point
validbeck May 2, 2025
e0e24f7
Save point
validbeck May 2, 2025
2823771
Save point
validbeck May 2, 2025
9210707
Save point
validbeck May 2, 2025
502c5f0
Save point
validbeck May 2, 2025
3f7d03d
Editing
validbeck May 2, 2025
1b24a54
Validator Module 1 draft
validbeck May 2, 2025
74a9c3a
Setup for Module 2
validbeck May 2, 2025
05abdb0
Save point module 2
validbeck May 2, 2025
a1dee9b
Save point module 2
validbeck May 2, 2025
7c57779
Save point module 2
validbeck May 2, 2025
602386a
Module 2 draft
validbeck May 2, 2025
9166f55
Setting up for 3 & 4
validbeck May 3, 2025
6c6aba0
Fixing merge conflicts
validbeck May 7, 2025
8619010
Module 3 WIP
validbeck May 7, 2025
935a052
save
validbeck May 7, 2025
ac68d33
Module 3 summary
validbeck May 7, 2025
30699cb
Module 4 save
validbeck May 7, 2025
a930f86
Save point
validbeck May 7, 2025
5b878ab
Adding missing info from old training WIP
validbeck May 7, 2025
a981d48
Save for day
validbeck May 7, 2025
c183a15
Module 4 WIP
validbeck May 8, 2025
cc80a1e
Adjusting fonts for developer training
validbeck May 8, 2025
159f7dd
Adjusting fonts for validator training
validbeck May 8, 2025
fa4ed52
Template & tweaks
validbeck May 8, 2025
c7f2586
Save point
validbeck May 8, 2025
6790a2f
Module 4 done
validbeck May 8, 2025
854341c
Modifying Makefile to copy both sets of notebooks
validbeck May 8, 2025
c170013
Pulling in latest notebooks to copy over exe
validbeck May 8, 2025
676c524
Updating URLS to executed Pt1
validbeck May 8, 2025
e8617d8
Updating URLS to executed Pt2
validbeck May 8, 2025
d79737a
Pulling in latest notebooks with typo fixes
validbeck May 8, 2025
a4f389c
Typo fix in anchor
validbeck May 8, 2025
251e0d7
Upating exxecute Make command
validbeck May 8, 2025
0bea110
Wrapper
validbeck May 8, 2025
69fbaa1
Proofreading
validbeck May 8, 2025
dfa7e1b
More proofreading
validbeck May 9, 2025
3df3344
More proofreading...
validbeck May 9, 2025
84ed624
Even more proofreading
validbeck May 9, 2025
d1da3c6
Adding analytics to Developer
validbeck May 9, 2025
2d19f93
Adding overview to Developer
validbeck May 9, 2025
5f56dd7
Trying something?
validbeck May 9, 2025
8ab974a
Adjust
validbeck May 9, 2025
9c4f9b1
Retrieving the package locally instead
validbeck May 9, 2025
0318c0c
Tweak
validbeck May 9, 2025
eb502c2
Trying something
validbeck May 9, 2025
a9104ed
Test
validbeck May 9, 2025
f39e938
Testing font resolve
validbeck May 12, 2025
70c5ac4
Latest widget pull
validbeck May 12, 2025
ddc905c
hm
validbeck May 12, 2025
07d0f67
Ugh
validbeck May 12, 2025
320f73d
Removing outdated widget embed
validbeck May 12, 2025
a5ad6cf
Removing unneeded widget dir
validbeck May 12, 2025
6268fc3
Modifying dev.env
validbeck May 12, 2025
1f7260d
Oops, missed one adjustment
validbeck May 12, 2025
0f340d8
Adding validation execution
validbeck May 12, 2025
4dbc91e
Adding cache to execution action
validbeck May 12, 2025
670bcee
Editing staging workflows
validbeck May 12, 2025
5b6f39e
Editing prod workflows
validbeck May 12, 2025
3bcbf73
Made filter more restrictive for notebooks
validbeck May 12, 2025
0725d4c
Edited validator permissions
validbeck May 13, 2025
ee7d5a3
Merge 'main' into beck/sc-8468/update-validator-fundamentals-course
validbeck May 13, 2025
29c1eb5
Updated notebooks from beck/ownership-edit
validbeck May 13, 2025
ebfb095
repo-actions: [issue]
validbeck May 13, 2025
5dd1428
Removing unneeded line in Makefile
validbeck May 13, 2025
53709ad
Reverting repo-actions
validbeck May 13, 2025
19ab61c
Pulling in latest from main, resolve conflicts
validbeck May 21, 2025
249ae57
Removing references to old development notebook
validbeck May 21, 2025
92ee90e
Forgot the JH variable
validbeck May 21, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
58 changes: 46 additions & 12 deletions .github/actions/demo-notebook/action.yml
Original file line number Diff line number Diff line change
@@ -1,14 +1,25 @@
name: Execute demo notebooks
description: Installs python3, validmind, checks dependencies then executes ONLY the Intro for Model Developers notebook with development heap tracking
description: Installs python3, validmind, checks dependencies then executes ONLY the training notebook series with development heap tracking

inputs:
env_file:
description: "Load the created .env file"
dev_env:
description: "Load the created dev.env file"
required: true
valid_env:
description: "Load the created valid.env file"
required: true

runs:
using: "composite"
steps:
- name: Cache pip dependencies
uses: actions/cache@v4
with:
path: ~/.cache/pip
key: python-pip-${{ runner.os }}-${{ hashFiles('.github/actions/demo-notebook/action.yml') }}
restore-keys: |
python-pip-${{ runner.os }}-

- name: Install python3 for Jupyter Notebooks
shell: bash
run: |
Expand All @@ -29,23 +40,46 @@ runs:
run: |
python -m ipykernel install --user --name validmind --display-name "ValidMind Library"

- name: Ensure .env file is available
- name: Ensure dev.env file is available
shell: bash
id: find_env
id: find_dev_env
run: |
if [ ! -f "${{ inputs.env_file }}" ]; then
echo "Error: .env file not found at ${{ inputs.env_file }}"
if [ ! -f "${{ inputs.dev_env }}" ]; then
echo "Error: dev.env file not found at ${{ inputs.dev_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model development series with heap development
shell: bash
if: ${{ steps.find_env.outcome == 'success' }}
if: ${{ steps.find_dev_env.outcome == 'success' }}
run: |
cd site
source ../${{ inputs.env_file }}
cp ../${{ inputs.dev_env }} ../.env
source ../.env
quarto render --profile exe-demo notebooks/EXECUTED/model_development &> render_errors.log || {
echo "Execute for ValidMind for model development series failed";
cat render_errors.log;
exit 1;
echo "Execute for ValidMind for model development series failed";
cat render_errors.log;
exit 1;
}

- name: Ensure valid.env file is available
shell: bash
id: find_valid_env
run: |
if [ ! -f "${{ inputs.valid_env }}" ]; then
echo "Error: valid.env file not found at ${{ inputs.valid_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model validation series with heap development
shell: bash
if: ${{ steps.find_valid_env.outcome == 'success' }}
run: |
cd site
cp ../${{ inputs.valid_env }} ../.env
source ../.env
quarto render --profile exe-demo notebooks/EXECUTED/model_validation &> render_errors.log || {
echo "Execute for ValidMind for model validation series failed";
cat render_errors.log;
exit 1;
}
62 changes: 48 additions & 14 deletions .github/actions/prod-notebook/action.yml
Original file line number Diff line number Diff line change
@@ -1,14 +1,25 @@
name: Execute prod notebooks
description: Installs python3, validmind, checks dependencies then executes ONLY the Intro for Model Developers notebook with production heap tracking
name: Execute production notebooks
description: Installs python3, validmind, checks dependencies then executes ONLY the training notebook series with production heap tracking

inputs:
env_file:
description: "Load the created .env file"
dev_env:
description: "Load the created dev.env file"
required: true
valid_env:
description: "Load the created valid.env file"
required: true

runs:
using: "composite"
steps:
- name: Cache pip dependencies
uses: actions/cache@v4
with:
path: ~/.cache/pip
key: python-pip-${{ runner.os }}-${{ hashFiles('.github/actions/prod-notebook/action.yml') }}
restore-keys: |
python-pip-${{ runner.os }}-

- name: Install python3 for Jupyter Notebooks
shell: bash
run: |
Expand All @@ -29,23 +40,46 @@ runs:
run: |
python -m ipykernel install --user --name validmind --display-name "ValidMind Library"

- name: Ensure .env file is available
- name: Ensure dev.env file is available
shell: bash
id: find_env
id: find_dev_env
run: |
if [ ! -f "${{ inputs.env_file }}" ]; then
echo "Error: .env file not found at ${{ inputs.env_file }}"
if [ ! -f "${{ inputs.dev_env }}" ]; then
echo "Error: dev.env file not found at ${{ inputs.dev_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model development series with heap production
shell: bash
if: ${{ steps.find_env.outcome == 'success' }}
if: ${{ steps.find_dev_env.outcome == 'success' }}
run: |
cd site
source ../${{ inputs.env_file }}
cp ../${{ inputs.dev_env }} ../.env
source ../.env
quarto render --profile exe-prod notebooks/EXECUTED/model_development &> render_errors.log || {
echo "Execute for ValidMind for model development series failed";
cat render_errors.log;
exit 1;
}
echo "Execute for ValidMind for model development series failed";
cat render_errors.log;
exit 1;
}

- name: Ensure valid.env file is available
shell: bash
id: find_valid_env
run: |
if [ ! -f "${{ inputs.valid_env }}" ]; then
echo "Error: valid.env file not found at ${{ inputs.valid_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model validation series with heap production
shell: bash
if: ${{ steps.find_valid_env.outcome == 'success' }}
run: |
cd site
cp ../${{ inputs.valid_env }} ../.env
source ../.env
quarto render --profile exe-prod notebooks/EXECUTED/model_validation &> render_errors.log || {
echo "Execute for ValidMind for model validation series failed";
cat render_errors.log;
exit 1;
}
60 changes: 47 additions & 13 deletions .github/actions/staging-notebook/action.yml
Original file line number Diff line number Diff line change
@@ -1,14 +1,25 @@
name: Execute staging notebooks
description: Installs python3, validmind, checks dependencies then executes ONLY the Intro for Model Developers notebook with staging heap tracking
description: Installs python3, validmind, checks dependencies then executes ONLY the training notebook series with staging heap tracking

inputs:
env_file:
description: "Load the created .env file"
dev_env:
description: "Load the created dev.env file"
required: true
valid_env:
description: "Load the created valid.env file"
required: true

runs:
using: "composite"
steps:
- name: Cache pip dependencies
uses: actions/cache@v4
with:
path: ~/.cache/pip
key: python-pip-${{ runner.os }}-${{ hashFiles('.github/actions/staging-notebook/action.yml') }}
restore-keys: |
python-pip-${{ runner.os }}-

- name: Install python3 for Jupyter Notebooks
shell: bash
run: |
Expand All @@ -29,23 +40,46 @@ runs:
run: |
python -m ipykernel install --user --name validmind --display-name "ValidMind Library"

- name: Ensure .env file is available
- name: Ensure dev.env file is available
shell: bash
id: find_env
id: find_dev_env
run: |
if [ ! -f "${{ inputs.env_file }}" ]; then
echo "Error: .env file not found at ${{ inputs.env_file }}"
if [ ! -f "${{ inputs.dev_env }}" ]; then
echo "Error: dev.env file not found at ${{ inputs.dev_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model development series with heap staging
shell: bash
if: ${{ steps.find_env.outcome == 'success' }}
if: ${{ steps.find_dev_env.outcome == 'success' }}
run: |
cd site
source ../${{ inputs.env_file }}
cp ../${{ inputs.dev_env }} ../.env
source ../.env
quarto render --profile exe-staging notebooks/EXECUTED/model_development &> render_errors.log || {
echo "Execute for iValidMind for model development series failed";
cat render_errors.log;
exit 1;
}
echo "Execute for ValidMind for model development series failed";
cat render_errors.log;
exit 1;
}

- name: Ensure valid.env file is available
shell: bash
id: find_valid_env
run: |
if [ ! -f "${{ inputs.valid_env }}" ]; then
echo "Error: valid.env file not found at ${{ inputs.valid_env }}"
exit 1
fi

- name: Execute ONLY the ValidMind for model validation series with heap staging
shell: bash
if: ${{ steps.find_valid_env.outcome == 'success' }}
run: |
cd site
cp ../${{ inputs.valid_env }} ../.env
source ../.env
quarto render --profile exe-staging notebooks/EXECUTED/model_validation &> render_errors.log || {
echo "Execute for ValidMind for model validation series failed";
cat render_errors.log;
exit 1;
}
39 changes: 27 additions & 12 deletions .github/workflows/deploy-docs-prod.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,23 +48,38 @@ jobs:
exit 1;
}

- name: Create .env file
id: create_env
# If yes then create the dev.env file for use in execution step
- name: Create dev.env file
if: steps.filter.outputs.notebooks == 'true'
id: create_dev_env
run: |
touch .env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> .env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> .env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> .env
echo VM_API_MODEL=${{ secrets.PLATFORM_DEV_MODEL }} >> .env
cat .env
touch dev.env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> dev.env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> dev.env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> dev.env
echo VM_API_MODEL=${{ secrets.PLATFORM_DEV_MODEL }} >> dev.env
cat dev.env

# Only execute the prod notebook if .env file is created
- name: Execute prod ValidMind for model development series
if: ${{ steps.create_env.outcome == 'success' }}
# If yes then create the valid.env file for use in execution step
- name: Create valid.env file
if: steps.filter.outputs.notebooks == 'true'
id: create_valid_env
run: |
touch valid.env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> valid.env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> valid.env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> valid.env
echo VM_API_MODEL=${{ secrets.PLATFORM_VALID_MODEL }} >> valid.env
cat valid.env

# Only execute the production notebooks for training if .env files are created
- name: Execute production ValidMind for model development and validation series
if: ${{ steps.create_dev_env.outcome == 'success' && steps.create_valid_env.outcome == 'success' }}
uses: ./.github/actions/prod-notebook
id: execute-prod-notebook
with:
env_file: .env
dev_env: dev.env
valid_env: valid.env

# Prod bucket is in us-east-1
- name: Configure AWS credentials
Expand Down
39 changes: 27 additions & 12 deletions .github/workflows/deploy-docs-staging.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,23 +38,38 @@ jobs:
exit 1;
}

- name: Create .env file
id: create_env
# If yes then create the dev.env file for use in execution step
- name: Create dev.env file
if: steps.filter.outputs.notebooks == 'true'
id: create_dev_env
run: |
touch .env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> .env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> .env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> .env
echo VM_API_MODEL=${{ secrets.PLATFORM_DEV_MODEL }} >> .env
cat .env
touch dev.env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> dev.env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> dev.env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> dev.env
echo VM_API_MODEL=${{ secrets.PLATFORM_DEV_MODEL }} >> dev.env
cat dev.env

# Only execute the staging notebook if .env file is created
- name: Execute staging ValidMind for model development series
if: ${{ steps.create_env.outcome == 'success' }}
# If yes then create the valid.env file for use in execution step
- name: Create valid.env file
if: steps.filter.outputs.notebooks == 'true'
id: create_valid_env
run: |
touch valid.env
echo VM_API_HOST=${{ secrets.PLATFORM_API_HOST }} >> valid.env
echo VM_API_KEY=${{ secrets.PLATFORM_API_KEY }} >> valid.env
echo VM_API_SECRET=${{ secrets.PLATFORM_API_SECRET }} >> valid.env
echo VM_API_MODEL=${{ secrets.PLATFORM_VALID_MODEL }} >> valid.env
cat valid.env

# Only execute the staging notebooks for training if .env files are created
- name: Execute staging ValidMind for model development and validation series
if: ${{ steps.create_dev_env.outcome == 'success' && steps.create_valid_env.outcome == 'success' }}
uses: ./.github/actions/staging-notebook
id: execute-staging-notebook
with:
env_file: .env
dev_env: dev.env
valid_env: valid.env

# Staging bucket is in us-west-2
- name: Configure AWS credentials
Expand Down
Loading
Loading