Extend HRRR analysis dataset back to 2014-10-01 with PRMSL/MSLMA variable name handling#431
Open
Extend HRRR analysis dataset back to 2014-10-01 with PRMSL/MSLMA variable name handling#431
Conversation
…able name handling The HRRR analysis dataset previously started at 2018-09-16 (HRRRv3). This extends it to 2014-10-01 (start of HRRR operations), adding 4+ years of historical data. Key changes: - Add grib_element_alternatives to NoaaInternalAttrs for variables whose GRIB element name changed across model versions - Update GRIB index parser and read_data to match against alternative element names - Set PRMSL as alternative for pressure_reduced_to_mean_sea_level (MSLMA in v3) - Add integration test verifying download+read works for pre-v3 and post-v3 data https://claude.ai/code/session_01SLHvx4dqQ4bjsLwQjJ1UGT
Skip variables with 0 matches (missing from index, e.g. pre-v3 DLWRF/RH) with log.exception, and use first match for duplicates (pre-v3 APCP/WEASD). Update integration test to pass all vars without pre-filtering. Add unit tests for grib_element_alternatives and missing var skip behavior. https://claude.ai/code/session_01SLHvx4dqQ4bjsLwQjJ1UGT
Only APCP is allowed to use first-match for duplicates (verified: pre-v3 HRRR entries differ by at most 13/1.9M cells, max 0.001 kg/m²). All other variables with non-unique matches are skipped with a logged exception. https://claude.ai/code/session_01SLHvx4dqQ4bjsLwQjJ1UGT
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The HRRR analysis dataset previously started at 2018-09-16 (HRRRv3). This extends
it to 2014-10-01 (start of HRRR operations), adding 4+ years of historical data.
Key changes:
element name changed across model versions
https://claude.ai/code/session_01SLHvx4dqQ4bjsLwQjJ1UGT