Skip to content

feat: add HMS grid output and cap intra-worker thread fan-out#6

Merged
HenryGeorgist merged 1 commit intoUSACE-Cloud-Compute:mainfrom
nghiemv:feat/hms-grid-and-thread-cap
Apr 15, 2026
Merged

feat: add HMS grid output and cap intra-worker thread fan-out#6
HenryGeorgist merged 1 commit intoUSACE-Cloud-Compute:mainfrom
nghiemv:feat/hms-grid-and-thread-cap

Conversation

@nghiemv
Copy link
Copy Markdown
Contributor

@nghiemv nghiemv commented Apr 15, 2026

  • New create-grid-file action emits <catalog_id>/catalog.grid in the legacy verbose HMS schema for HMS 4.x compatibility. Storm centers are projected to HEC's Albers SHG frame.
  • Rename output subdir dss/ -> data/ so grid DSS paths read naturally.
  • Cap OMP/OpenBLAS/MKL/NumExpr thread counts to 1 per worker so memory scales with worker count only, not workers x cpu_count.
  • Set explicit docker-compose image tag (storm-cloud-plugin:latest).

Tested by adding the 'catalog.grid' (renamed to match the project's name) and 'data/*.dss' files into an HEC-HMS project, and verified that the grids showed up in the UI.

- New create-grid-file action emits <catalog_id>/catalog.grid in the
  legacy verbose HMS schema for HMS 4.x compatibility. Storm centers
  are projected to HEC's Albers SHG frame.
- Rename output subdir dss/ -> data/ so grid DSS paths read naturally.
- Cap OMP/OpenBLAS/MKL/NumExpr thread counts to 1 per worker so
  memory scales with worker count only, not workers x cpu_count.
- Set explicit docker-compose image tag (storm-cloud-plugin:latest).
@nghiemv nghiemv force-pushed the feat/hms-grid-and-thread-cap branch from b3f773d to 9755047 Compare April 15, 2026 20:17
{ "name": "download-inputs", "type": "utils", "description": "Download geometries", "attributes": {}, "stores": [], "inputs": [], "outputs": [] },
{ "name": "process-storms", "type": "run", "description": "Create STAC storm catalog", "attributes": {}, "stores": [], "inputs": [], "outputs": [] },
{ "name": "convert-to-dss", "type": "extract", "description": "Convert Zarr to HEC-DSS", "attributes": {}, "stores": [], "inputs": [], "outputs": [] },
{ "name": "create-grid-file", "type": "run", "description": "Emit HEC-HMS Grid Manager file", "attributes": {}, "stores": [], "inputs": [], "outputs": [] },
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

love it

Copy link
Copy Markdown
Collaborator

@HenryGeorgist HenryGeorgist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks great, will test tonight

@HenryGeorgist HenryGeorgist merged commit 3618a09 into USACE-Cloud-Compute:main Apr 15, 2026
2 checks passed
@nghiemv nghiemv deleted the feat/hms-grid-and-thread-cap branch April 17, 2026 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants