Skip to content

Commit a0a04b7

Browse files
authored
Update data-management.md
1 parent 1d1287e commit a0a04b7

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

docs/data-management.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -27,15 +27,15 @@ Effective data management is critical when working on the Euler Cluster, particu
2727
## 📦 Project Directory (`/cluster/project/rsl/$USER`)
2828

2929
- **Quota**: ≤ 75 GB
30-
- **Inodes**: ~300,000
30+
- **Inodes**: ~2.5 M
3131
- **Use Case**: Conda environments, software packages
3232

3333
---
3434

3535
## 📂 Work Directory (`/cluster/work/rsl/$USER`)
3636

37-
- **Quota**: ≤ 150 GB
38-
- **Inodes**: ~30,000
37+
- **Quota**: ≤ 200 GB
38+
- **Inodes**: ~50,000
3939
- **Use Case**: Saving results, large output files, tar files, singularity images. Avoid storing too many small files.
4040

4141
> In exceptional cases we can approve more storage space. For this, ask your supervisor to contact `patelm@ethz.ch`.
@@ -73,8 +73,8 @@ Whenever you run a compute job, you can also ask for a certain amount of local s
7373
|----------------------------|------------|----------------|--------|----------------------------------------------------|
7474
| `/cluster/home/$USER` | ~450,000 | 45 GB | No | Code, config, small files |
7575
| `/cluster/scratch/$USER` | 1 M | 2.5 TB | Yes (older than 15 days) | Datasets, training data, temporary usage |
76-
| `/cluster/project/rsl/$USER` | 300,000 | 75 GB | No | Conda envs, software packages |
77-
| `/cluster/work/rsl/$USER` | 30,000 | 150 GB | No | Large result files, model checkpoints, Singularity containers, |
76+
| `/cluster/project/rsl/$USER` | 2.5 M | 75 GB | No | Conda envs, software packages |
77+
| `/cluster/work/rsl/$USER` | 50,000 | 200 GB | No | Large result files, model checkpoints, Singularity containers, |
7878
| `$TMPDIR` | very high | Upto 800 GB | Yes (at end of job) | Training Datasets, Singularity Images |
7979

8080
---
@@ -98,4 +98,4 @@ sbatch test_storage_quotas.sh
9898
2. **Compress datasets** - Use tar/zip to reduce inode usage
9999
3. **Clean up regularly** - Remove old data from scratch before it's auto-deleted
100100
4. **Monitor your usage** - Check quotas regularly with `lquota`
101-
5. **Use `$TMPDIR` for active jobs** - Copy data to local scratch for faster I/O during computation
101+
5. **Use `$TMPDIR` for active jobs** - Copy data to local scratch for faster I/O during computation

0 commit comments

Comments
 (0)