@@ -27,15 +27,15 @@ Effective data management is critical when working on the Euler Cluster, particu
27
27
## 📦 Project Directory (` /cluster/project/rsl/$USER ` )
28
28
29
29
- ** Quota** : ≤ 75 GB
30
- - ** Inodes** : ~ 300,000
30
+ - ** Inodes** : ~ 2.5 M
31
31
- ** Use Case** : Conda environments, software packages
32
32
33
33
---
34
34
35
35
## 📂 Work Directory (` /cluster/work/rsl/$USER ` )
36
36
37
- - ** Quota** : ≤ 150 GB
38
- - ** Inodes** : ~ 30 ,000
37
+ - ** Quota** : ≤ 200 GB
38
+ - ** Inodes** : ~ 50 ,000
39
39
- ** Use Case** : Saving results, large output files, tar files, singularity images. Avoid storing too many small files.
40
40
41
41
> In exceptional cases we can approve more storage space. For this, ask your supervisor to contact ` patelm@ethz.ch ` .
@@ -73,8 +73,8 @@ Whenever you run a compute job, you can also ask for a certain amount of local s
73
73
| ----------------------------| ------------| ----------------| --------| ----------------------------------------------------|
74
74
| ` /cluster/home/$USER ` | ~ 450,000 | 45 GB | No | Code, config, small files |
75
75
| ` /cluster/scratch/$USER ` | 1 M | 2.5 TB | Yes (older than 15 days) | Datasets, training data, temporary usage |
76
- | ` /cluster/project/rsl/$USER ` | 300,000 | 75 GB | No | Conda envs, software packages |
77
- | ` /cluster/work/rsl/$USER ` | 30 ,000 | 150 GB | No | Large result files, model checkpoints, Singularity containers, |
76
+ | ` /cluster/project/rsl/$USER ` | 2.5 M | 75 GB | No | Conda envs, software packages |
77
+ | ` /cluster/work/rsl/$USER ` | 50 ,000 | 200 GB | No | Large result files, model checkpoints, Singularity containers, |
78
78
| ` $TMPDIR ` | very high | Upto 800 GB | Yes (at end of job) | Training Datasets, Singularity Images |
79
79
80
80
---
@@ -98,4 +98,4 @@ sbatch test_storage_quotas.sh
98
98
2 . ** Compress datasets** - Use tar/zip to reduce inode usage
99
99
3 . ** Clean up regularly** - Remove old data from scratch before it's auto-deleted
100
100
4 . ** Monitor your usage** - Check quotas regularly with ` lquota `
101
- 5 . ** Use ` $TMPDIR ` for active jobs** - Copy data to local scratch for faster I/O during computation
101
+ 5 . ** Use ` $TMPDIR ` for active jobs** - Copy data to local scratch for faster I/O during computation
0 commit comments