Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
141 commits
Select commit Hold shift + click to select a range
45dc4d2
Revert "chore: update apt versions based on rebuild"
gfidlab-ci-user Jun 30, 2025
a7f10c3
Revert "WIP: remove apt versions for rebuild"
gfidlab-ci-user Jun 30, 2025
f9be4ee
Revert "chore: update apt versions based on rebuild"
gfidlab-ci-user Jun 30, 2025
efa15b2
revert
gfidlab-ci-user Jun 30, 2025
17c9ba3
Merge branch 'main' into update-apt-package-versions-20250623
oleschwen Jul 7, 2025
ad98dca
Merge pull request #66 from KatherLab/update-apt-package-versions-202…
oleschwen Jul 7, 2025
c848766
chore: simplify APT package installation in Dockerfile and update bui…
gfidlab-ci-user Jul 7, 2025
6112765
Merge remote-tracking branch 'origin/fix_aut_apt_update_githubaction'…
gfidlab-ci-user Jul 7, 2025
da4e3ec
Merge branch 'main' into dev-34-latest-update-from-gustav-code
gfidlab-ci-user Jul 7, 2025
0c917e0
Potential fix for code scanning alert no. 3: Workflow does not contai…
Ultimate-Storm Jul 7, 2025
66d7856
Merge pull request #67 from KatherLab/fix_aut_apt_update_githubaction
Ultimate-Storm Jul 7, 2025
ee7f57d
updated apt package versions
oleschwen Jul 8, 2025
3a01730
Merge branch 'apt-version-update-20250708' into dev-34-latest-update-…
oleschwen Jul 8, 2025
f7c9afc
install einops and x-transformers which apparently is no longer avail…
oleschwen Jul 8, 2025
f68b582
removed precision specification that apparently does not work any more
oleschwen Jul 8, 2025
fce123d
add pre-trained model to docker image
oleschwen Jul 8, 2025
95e589f
check that the correct version of the pretrained weights is available…
oleschwen Jul 8, 2025
953857d
download pretrained model weights if not already available
oleschwen Jul 8, 2025
7ad0178
quoted, as suggested by copilot
oleschwen Jul 8, 2025
ee26af0
adapted to changed argument in script
oleschwen Jul 8, 2025
4860629
restored base image and pip package installation/versions that were a…
oleschwen Jul 8, 2025
0d00d52
Revert "removed precision specification that apparently does not work…
oleschwen Jul 8, 2025
6de586b
chore: simplify APT package installation in Dockerfile and update bui…
gfidlab-ci-user Jul 9, 2025
8232bc2
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 9, 2025
003f5fb
chore: update apt versions based on rebuild
gfidlab-ci-user Jul 9, 2025
40914c2
fix echo
Ultimate-Storm Jul 9, 2025
3c7e3e8
slightly extended README and marked todos
oleschwen Jul 9, 2025
b233434
updated apt package versions
oleschwen Jul 9, 2025
4280c62
Merge branch 'apt-version-update-20250708' into dev-34-latest-update-…
oleschwen Jul 9, 2025
badbc6a
incremented version number
oleschwen Jul 9, 2025
d17cf4f
Merge pull request #58 from KatherLab/dev-34-latest-update-from-gusta…
Ultimate-Storm Jul 10, 2025
9881cf6
Merge remote-tracking branch 'origin/main'
gfidlab-ci-user Jul 10, 2025
d4cc4dc
feat: add Odelia all sites configuration YAML for server and client s…
Ultimate-Storm Jul 10, 2025
5e11d99
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 10, 2025
1c17c46
chore: pin APT package versions in Dockerfile for consistency
gfidlab-ci-user Jul 10, 2025
5c1d0c0
chore: enhance APT update workflow with debug logging and final Docke…
gfidlab-ci-user Jul 10, 2025
8016685
chore: update APT version check to use dpkg for improved accuracy
Ultimate-Storm Jul 10, 2025
2ca49b3
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 10, 2025
7a1ff1a
chore: pin APT package versions in Dockerfile and update version chec…
gfidlab-ci-user Jul 10, 2025
242a483
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 10, 2025
8dd171a
chore: update APT package versions in Dockerfile and adjust CI workflow
Ultimate-Storm Jul 10, 2025
a4c97b6
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 10, 2025
9a8ad27
chore: update apt versions in Dockerfile_ODELIA
Ultimate-Storm Jul 10, 2025
cba7221
Potential fix for code scanning alert no. 4: Workflow does not contai…
Ultimate-Storm Jul 10, 2025
1fb41d4
chore: restructure project files and add initial scripts for ODELIA d…
gfidlab-ci-user Jul 10, 2025
f0cf386
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 10, 2025
d0f7a65
fix: pin APT package versions in Dockerfile for consistent builds
gfidlab-ci-user Jul 10, 2025
055ad7a
chore: copy pre-trained model weights to Docker image
gfidlab-ci-user Jul 10, 2025
b1b5827
Merge pull request #71 from KatherLab/fix_ci_apt_update
Ultimate-Storm Jul 10, 2025
de3d561
docs: add developer and operator usage guides to README files
Ultimate-Storm Jul 10, 2025
d1893ba
docs: update README badges for PR tests and build status
gfidlab-ci-user Jul 10, 2025
d2e3b5d
fix: comment out git fetch and diff check in update_apt_versions.sh
gfidlab-ci-user Jul 10, 2025
5d04b91
Merge pull request #78 from KatherLab/ci/apt-update-1752138322
Ultimate-Storm Jul 10, 2025
5c1a536
Update README.md
Ultimate-Storm Jul 10, 2025
ac86350
Update assets/readme/README.participant.md
Ultimate-Storm Jul 10, 2025
73b685e
Update assets/readme/README.participant.md
Ultimate-Storm Jul 10, 2025
2405785
Update assets/readme/README.developer.md
Ultimate-Storm Jul 10, 2025
77ebb12
chore: rename README_old.md for improved organization
gfidlab-ci-user Jul 10, 2025
bee3234
Merge remote-tracking branch 'origin/dev_demo_odelia' into dev_demo_o…
gfidlab-ci-user Jul 10, 2025
287dd37
Merge branch 'main' into dev_demo_odelia
gfidlab-ci-user Jul 10, 2025
ad71a2e
Merge pull request #79 from KatherLab/dev_demo_odelia
Ultimate-Storm Jul 10, 2025
40893b4
iterated README for swarm participants
oleschwen Jul 10, 2025
9a2b3fd
note on site name
oleschwen Jul 10, 2025
3b4196e
indentation for nested list
oleschwen Jul 10, 2025
85387a0
moved local training before swarm training
oleschwen Jul 10, 2025
b0c7829
fix: update script paths in README for improved clarity
gfidlab-ci-user Jul 10, 2025
bf21531
addressed some todos and moved description of docker.sh (in startup k…
oleschwen Jul 11, 2025
b0d4e44
Merge pull request #82 from KatherLab/fix_odelia_preprocessing_docume…
Ultimate-Storm Jul 11, 2025
0304a59
updated apt package versions
oleschwen Jul 11, 2025
8878603
fix: enable change detection in update_apt_versions.sh
gfidlab-ci-user Jul 11, 2025
73f229a
Merge pull request #84 from KatherLab/fix-apt-versions-20250711
oleschwen Jul 11, 2025
5a80a9e
Merge branch 'main' into 80-improve-documentation-in-readme-files
oleschwen Jul 11, 2025
d970624
Merge pull request #81 from KatherLab/80-improve-documentation-in-rea…
oleschwen Jul 11, 2025
bc40815
feat: add new client configuration for MEVIS_3 in project_Odelia_alls…
gfidlab-ci-user Jul 11, 2025
42dc422
added tee to capture command line output to files
oleschwen Jul 14, 2025
fce2d9a
explanation on local training, not marked as optional for now
oleschwen Jul 14, 2025
8a66d0f
Merge pull request #87 from KatherLab/fix-add-capturing-output-to-readme
oleschwen Jul 14, 2025
a3ff6e8
made source more readable
oleschwen Jul 14, 2025
c4829e4
output what is actually used as number of classes
oleschwen Jul 14, 2025
5e4ef33
removed misleading comment
oleschwen Jul 14, 2025
3b6d5ce
removed confusing output for now
oleschwen Jul 14, 2025
346d21c
use http for communication also in tests
oleschwen Jul 15, 2025
85bf8dd
updated apt package versions
oleschwen Jul 15, 2025
420b5a9
Merge pull request #88 from KatherLab/fix-omit-confusing-number-of-la…
Ultimate-Storm Jul 15, 2025
9509e13
chore: update APT version update workflow with permissions and branch…
gfidlab-ci-user Jul 16, 2025
064e53f
chore: refine APT update workflow by removing branch condition and en…
gfidlab-ci-user Jul 16, 2025
45d2d4d
Merge branch 'ci/apt-update'
gfidlab-ci-user Jul 16, 2025
dc40756
chore: update APT version update workflow with permissions and branch…
gfidlab-ci-user Jul 16, 2025
c103523
feat: enhance Docker build script and add initial Dockerfile for STAM…
gfidlab-ci-user Jul 17, 2025
7475cec
feat: add initial implementation of VaryPrecisionTransform and relate…
gfidlab-ci-user Jul 17, 2025
5882258
feat: add configuration files for federated client and server setup
gfidlab-ci-user Jul 17, 2025
a023eb2
chore: update apt versions in Dockerfile_ODELIA
Ultimate-Storm Jul 21, 2025
7a4561e
Merge pull request #93 from KatherLab/ci/apt-update-1753072085
oleschwen Jul 21, 2025
17ffb1f
create scratch dir only at user-writable location, avoid need for sud…
oleschwen Jul 21, 2025
c044dda
refactor: reorganize project structure and update import paths for ST…
gfidlab-ci-user Jul 21, 2025
a4c194d
ignore openvpn configuration files at recommended location
oleschwen Jul 22, 2025
f0f7101
log mediswarm version in training (passed to the Docker container as …
oleschwen Jul 22, 2025
d0a893c
try ResNet 10 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
0ed0b3a
try ResNet 18 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
7c248a3
try ResNet 34 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
1524a6a
try ResNet 50 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
dd83ca1
try ResNet 101 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
22bbb72
try ResNet 152 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
0c6a27d
set parameters for pre-trained ResNet depending on variant rather tha…
oleschwen Jul 22, 2025
97d609c
try ResNet 10 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
e5d3baa
try ResNet 18 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
1b111e7
try ResNet 34 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
daa6e0f
try ResNet 50 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
92e1ba9
try ResNet 101 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
ecf04ad
try ResNet 152 (pretrained; downloaded from within container)
oleschwen Jul 22, 2025
b2b5b56
omit potentially large workspace directory from copy (from which it w…
oleschwen Jul 22, 2025
147173c
fixed rsync option to exclude directory
oleschwen Jul 22, 2025
dc9518f
back to MST
oleschwen Jul 24, 2025
9cc8169
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 28, 2025
1ee9290
chore: format APT install lines for better readability
gfidlab-ci-user Jul 28, 2025
2e3c5c4
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 28, 2025
b556bdd
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 28, 2025
a5fb311
refactor: update parse_apt_versions to return a dictionary of package…
gfidlab-ci-user Jul 28, 2025
1710d40
WIP: remove apt versions for rebuild
gfidlab-ci-user Jul 28, 2025
41ac377
refactor: optimize regex pattern for parsing APT versions
gfidlab-ci-user Jul 28, 2025
4a28fe7
chore: update apt versions in Dockerfile_ODELIA
Ultimate-Storm Jul 29, 2025
25b662b
restored lost apt package version
oleschwen Jul 29, 2025
8691b72
Merge pull request #98 from KatherLab/ci/apt-update-1753763278
oleschwen Jul 29, 2025
9c2c082
A working version
gfidlab-ci-user Jul 29, 2025
e005b37
chore: update apt versions in Dockerfile_ODELIA
Ultimate-Storm Jul 30, 2025
cf6f187
Merge pull request #99 from KatherLab/ci/apt-update-1753849694
oleschwen Jul 30, 2025
d0bf26b
Merge branch 'main' into dev-85-implement-feedback-on-readme-files
oleschwen Jul 30, 2025
3a73505
fix: update max_epochs parameter to 64 for improved training duration
gfidlab-ci-user Jul 30, 2025
618444b
fix: remove unnecessary line breaks in APT installation commands
gfidlab-ci-user Jul 30, 2025
ee53d3a
keep argument -y in same line as RUN apt install
oleschwen Jul 30, 2025
9bbb055
updated apt version numbers
oleschwen Jul 30, 2025
494f6a3
refactored to remove duplicate definitions
oleschwen Jul 30, 2025
e5614d9
Merge branch 'main' into fix_apt_versions_separate_lines
oleschwen Jul 30, 2025
f7d0609
Merge pull request #97 from KatherLab/fix_apt_versions_separate_lines
Ultimate-Storm Jul 31, 2025
04d5b0a
Merge branch 'main' into dev-85-implement-feedback-on-readme-files
oleschwen Jul 31, 2025
19f6b3c
added potential pitfalls
oleschwen Jul 31, 2025
a552c58
Merge pull request #96 from KatherLab/dev-85-implement-feedback-on-re…
oleschwen Aug 12, 2025
a135e1f
Merge remote-tracking branch 'origin/main' into dev_stamp_integration
gfidlab-ci-user Aug 19, 2025
3b730ea
delete unused files
gfidlab-ci-user Aug 19, 2025
48c3770
feat: enhance configuration and data loading for patient-level features
gfidlab-ci-user Aug 19, 2025
f06cd1e
feat: add configuration classes for training and deployment settings
gfidlab-ci-user Aug 19, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 7 additions & 4 deletions .github/workflows/pr-test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,9 @@ on:
- main
- dev

permissions:
contents: read

jobs:
validate-swarm:
runs-on: self-hosted
Expand Down Expand Up @@ -61,13 +64,13 @@ jobs:
echo "=== Checking log output ==="
ls -lh workspace/*/prod_00/client_A/logs || echo "No logs found for dummy training"

- name: Run 3D CNN preflight check
- name: Run 3D CNN tests
continue-on-error: false
run: |
./runTestsInDocker.sh preflight_check
echo "Preflight check finished"
./runTestsInDocker.sh run_3dcnn_tests
echo "3D CNN tests check finished"
echo "=== Checking synthetic log output ==="
ls -lh workspace/*/prod_00/client_A/logs || echo "No logs found for preflight"
ls -lh workspace/*/prod_00/client_A/logs || echo "No logs found for 3D CNN tests"

- name: Run Unit Tests inside Docker
continue-on-error: true
Expand Down
44 changes: 15 additions & 29 deletions .github/workflows/update-apt-versions.yml
Original file line number Diff line number Diff line change
@@ -1,67 +1,53 @@
name: Auto Update APT Versions
name: Auto Update APT Versions (Self-hosted)

on:
schedule:
- cron: '0 5 * * 0' # Every Sunday at 05:00 UTC
# run eveyday at 04:00 UTC
- cron: '0 4 * * *'
workflow_dispatch:

jobs:
update-apt:
name: Update APT Package Versions in Dockerfile
runs-on: ubuntu-latest
runs-on: self-hosted
timeout-minutes: 60

steps:
- name: Checkout repository (with submodules)
uses: actions/checkout@v3
with:
submodules: true
fetch-depth: 0

- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: '3.x'

- name: Install dependencies
run: sudo apt-get update && sudo apt-get install -y git

- name: Configure Git for CI
- name: Set up Git
run: |
git config --global user.email "ci@github.com"
git config --global user.name "GitHub CI"

- name: Create and switch to apt-update branch
run: |
git checkout -b ci/apt-update || git switch ci/apt-update

- name: Make update script executable
run: chmod +x scripts/ci/update_apt_versions.sh

- name: Run APT update script
run: scripts/ci/update_apt_versions.sh

- name: Check for changes
id: check_changes
run: |
if git diff --quiet; then
echo "NO_CHANGES=true" >> $GITHUB_ENV
echo "No changes detected."
else
echo "NO_CHANGES=false" >> $GITHUB_ENV
echo "Changes detected."
fi
chmod +x scripts/ci/update_apt_versions.sh
scripts/ci/update_apt_versions.sh
- name: Show git diff for debugging
run: git diff || true

- name: Push ci/apt-update to origin
- name: Push apt-update branch
if: env.NO_CHANGES == 'false'
run: git push origin ci/apt-update
run: git push origin ci/apt-update --force

- name: Create Pull Request
if: env.NO_CHANGES == 'false'
uses: peter-evans/create-pull-request@v5
with:
commit-message: "chore: update apt versions in Dockerfile_ODELIA"
branch: ci/apt-update
branch-suffix: timestamp
title: "chore: Update APT versions in Dockerfile"
body: |
This PR automatically updates APT package version numbers in `Dockerfile_ODELIA`
based on a rebuild and inspection of installation logs.
base: main
delete-branch: false
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -180,3 +180,6 @@ provision

# Ignore provisioned files
/workspace/

# Ignore directory for caching pre-trained models
docker_config/torch_home_cache
Loading
Loading