Skip to content

chore: Migrate gsutil usage to gcloud storage #473

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kralka merged 2 commits into from
Feb 10, 2026
Merged

chore: Migrate gsutil usage to gcloud storage #473

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f146218
chore: Migrate gsutil usage to gcloud storage
gurusai-voleti Feb 9, 2026
a00b6b4
Update README.md
kralka Feb 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions papers/2024/GPAM/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -103,8 +103,8 @@ loaded_model = tf.keras.models.load_model(

How to use with [sedpack](https://github.com/google/sedpack) coming soon (if
you already downloaded the datasets four small json files per dataset will be
needed, if you used `gsutil rsync` to download, these will be downloaded very
fast).
needed, if you used `gcloud storage rsync` to download, these will be downloaded
very fast).

For now see the tutorial
[https://google.github.io/sedpack/tutorials/sca/gpam/](https://google.github.io/sedpack/tutorials/sca/gpam/).
Expand Down
6 changes: 3 additions & 3 deletions papers/datasets/ECC/GPAM/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,13 +14,13 @@ Learning](https://github.com/google/scaaml/tree/main/papers/2024/GPAM).

```bash
# List available datasets
gsutil ls gs://scaaml-public/datasets/ECC/GPAM
gcloud storage ls gs://scaaml-public/datasets/ECC/GPAM
# Show size of the directory
gsutil du -sh gs://scaaml-public/datasets/ECC/GPAM
gcloud storage du --summarize --readable-sizes gs://scaaml-public/datasets/ECC/GPAM

# Download all (beware that the multiprocessing option -m can saturate your
# network connection). Or download just the dataset you want.
gsutil -m rsync -r gs://scaaml-public/datasets/ECC/GPAM .
gcloud storage rsync --recursive gs://scaaml-public/datasets/ECC/GPAM .
```

## How to load and use a dataset
Expand Down
2 changes: 1 addition & 1 deletion project-words.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,7 @@ explainability
figsize
firstrow
frombuffer
gsutil
gcloud storage
hardcopyarea
howpublished
htmlcov
Expand Down
Loading