Skip to content

Commit 096de6c

Browse files
author
Idate96
committed
Remove unnecessary setup scripts and workflow file
1 parent bcea634 commit 096de6c

File tree

7 files changed

+119
-105
lines changed

7 files changed

+119
-105
lines changed

docs/data-management.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,19 @@ Whenever you run a compute job, you can also ask for a certain amount of local s
7979

8080
---
8181

82+
## 🧪 Test Scripts
83+
84+
To verify your storage setup and check quotas:
85+
86+
- **[test_storage_quotas.sh](scripts/tests/data-management/test_storage_quotas.sh)** - Checks all storage paths, quotas, and creates missing directories
87+
88+
Submit as a job to test `$TMPDIR`:
89+
```bash
90+
sbatch test_storage_quotas.sh
91+
```
92+
93+
---
94+
8295
## 💡 Best Practices
8396

8497
1. **Use the right storage for the right purpose** - Don't waste home directory space on large files

docs/getting-started.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -136,6 +136,19 @@ Once you are logged into the Euler cluster, it's important to confirm that you h
136136

137137
---
138138

139+
## 🧪 Test Scripts
140+
141+
To verify your setup is working correctly, we provide test scripts:
142+
143+
- **[test_group_membership.sh](scripts/tests/getting-started/test_group_membership.sh)** - Verifies RSL group membership and creates user directories
144+
145+
Run the test after logging in:
146+
```bash
147+
bash /path/to/test_group_membership.sh
148+
```
149+
150+
---
151+
139152
## Next Steps
140153

141154
Once you have verified your access:

docs/python-environments.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -375,6 +375,25 @@ python analyze_results.py --results-dir /cluster/project/rsl/$USER/results/<job_
375375

376376
---
377377

378+
## 🧪 Test Scripts
379+
380+
We provide complete test scripts to verify the ML workflow:
381+
382+
- **[fake_train.py](scripts/tests/python-environments/fake_train.py)** - Simulated ML training script for testing
383+
- **[test_full_training_job.sh](scripts/tests/python-environments/test_full_training_job.sh)** - Complete ML training job test
384+
385+
To test the full workflow:
386+
```bash
387+
# Copy scripts to your project
388+
cp fake_train.py /cluster/home/$USER/
389+
cp test_full_training_job.sh /cluster/home/$USER/
390+
391+
# Submit the test job
392+
sbatch test_full_training_job.sh
393+
```
394+
395+
---
396+
378397
## 📝 Sample Training Script
379398

380399
For a complete training script example with all features (checkpointing, logging, etc.), see the [Computing Guide](computing-guide.md) or download our template from the [Scripts Library](scripts.md).
Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,74 @@
1+
#!/bin/bash
2+
#SBATCH --job-name=test-storage
3+
#SBATCH --output=test_storage_%j.out
4+
#SBATCH --error=test_storage_%j.err
5+
#SBATCH --time=00:05:00
6+
#SBATCH --ntasks=1
7+
#SBATCH --cpus-per-task=1
8+
#SBATCH --mem-per-cpu=1G
9+
#SBATCH --tmp=10G
10+
11+
echo "Storage Quota and Path Test"
12+
echo "==========================="
13+
echo "Job ID: $SLURM_JOB_ID"
14+
echo "Running on: $(hostname)"
15+
echo "Date: $(date)"
16+
echo ""
17+
18+
# Test home directory
19+
echo "1. Home Directory (/cluster/home/$USER)"
20+
echo "----------------------------------------"
21+
echo "Path exists: $([ -d /cluster/home/$USER ] && echo '✓ Yes' || echo '✗ No')"
22+
df -h /cluster/home/$USER
23+
echo ""
24+
25+
# Test scratch directory
26+
echo "2. Scratch Directory (/cluster/scratch/$USER)"
27+
echo "----------------------------------------"
28+
if [ -d /cluster/scratch/$USER ]; then
29+
echo "Path exists: ✓ Yes"
30+
df -h /cluster/scratch/$USER
31+
else
32+
echo "Path exists: ✗ No - Creating..."
33+
mkdir -p /cluster/scratch/$USER
34+
fi
35+
echo ""
36+
37+
# Test project directory
38+
echo "3. Project Directory (/cluster/project/rsl/$USER)"
39+
echo "----------------------------------------"
40+
echo "Path exists: $([ -d /cluster/project/rsl/$USER ] && echo '✓ Yes' || echo '✗ No')"
41+
df -h /cluster/project/rsl/$USER 2>/dev/null || echo "Not accessible"
42+
echo ""
43+
44+
# Test work directory
45+
echo "4. Work Directory (/cluster/work/rsl/$USER)"
46+
echo "----------------------------------------"
47+
echo "Path exists: $([ -d /cluster/work/rsl/$USER ] && echo '✓ Yes' || echo '✗ No')"
48+
df -h /cluster/work/rsl/$USER 2>/dev/null || echo "Not accessible"
49+
echo ""
50+
51+
# Test local scratch
52+
echo "5. Local Scratch ($TMPDIR)"
53+
echo "----------------------------------------"
54+
echo "Path: $TMPDIR"
55+
echo "Path exists: $([ -d $TMPDIR ] && echo '✓ Yes' || echo '✗ No')"
56+
df -h $TMPDIR
57+
echo ""
58+
59+
# Check quotas
60+
echo "6. Quota Information"
61+
echo "----------------------------------------"
62+
echo "Home and Scratch quotas:"
63+
lquota
64+
65+
echo ""
66+
echo "RSL Project/Work usage:"
67+
echo "Project directory:"
68+
(head -n 5 && grep -w $USER) < /cluster/project/rsl/.rsl_user_data_usage.txt 2>/dev/null || echo "Usage data not available"
69+
echo ""
70+
echo "Work directory:"
71+
(head -n 5 && grep -w $USER) < /cluster/work/rsl/.rsl_user_data_usage.txt 2>/dev/null || echo "Usage data not available"
72+
73+
echo ""
74+
echo "Test completed!"

github-actions-workflow.yml

Lines changed: 0 additions & 29 deletions
This file was deleted.

setup_github.sh

Lines changed: 0 additions & 33 deletions
This file was deleted.

setup_mkdocs.sh

Lines changed: 0 additions & 43 deletions
This file was deleted.

0 commit comments

Comments
 (0)