Releases: ACCESS-Cloud-Based-InSAR/DockerizedTopsApp
Releases · ACCESS-Cloud-Based-InSAR/DockerizedTopsApp
DockerizedTopsApp v1.0.2
Changed
- Upgraded to
asf_search>=10.0.5to resolve jobs failing withASFAuthenticationError: Username or password is incorrect
due to asfadmin/Discovery-asf_search#396.
DockerizedTopsApp v1.0.1
Added
- Support for latest ISCE2 and therefore python 3.10 - 3.12!
- Sentinel-1C support (inherited from ISCE2). Ensure we are not filtering for S1C in localization.
- Error out for S1C data generated prior to May 19th, 2025 as noted here: https://sentinels.copernicus.eu/-/sentinel-1c-products-are-now-calibrated
- Use ruff rather than flake8 (added to environment.yml), update actions to latest, and ensure we are up-to-date for CI/CD.
- Fix ruff formatting across repository
DockerizedTopsApp v1.0.0
This update provides new functionality for production of an the earthquake-specific, sensor-agnostic COSEIS_SAR product, while leaving the standard GUNW product generation functionality (0.6.0) unchanged.
Added
coseis_sarentry point andcoseis_sarfunction added in__main__.pyandsetup.py, enabling generation ofCOSEIS_SARproducts using existingGUNWframework.create_viz.pyadded to generate visualization files (single-band geotiffs, multi-band geotiffs,and imgtiffs) for delivery to S3 alongsideCOSEIS_SARnetCDF product (only when++process coseis_saris specified).convert_offsets.pyadded to convert dense pixel offsets (range/azimuth) units from pixels to meters forCOSEIS_SARproduct (only when++process coseis_saris specified).convert_unwrapped.pyadded to convert unwrapped phase from units of radians to meters forCOSEIS_SARproduct (only when++process coseis_saris specified).
Changed
- Updated
delivery_prep.py,packaging.py,__main__.pyto accommodate a variable naming scheme (currentlyGUNWandCOSEIS_SARare supported) and corresponding versioning for each product.product_naming_schemefunction added topackaging.pyto return product name/version basedproductspecified by user (GUNWorCOSEIS_SAR).GUNWremains the default naming/versioning scheme if noproductis specified.productargument added toprepare_for_deliveryandformat_metadatafunctions indelivery_prep.pyand topackage_gunw_product,get_gunw_id,perform_netcdf_packaging, and_write_json_configfunctions inpackaging.py. These modifications leverage newproduct_naming_schemefunction frompackaging.pyto generate name/version dynamically for metadata and netCDF file naming purposes.
- Updated tests to accommodate dynamic naming/versioning scheme for
GUNWandCOSEIS_SARproducts.- Rather than importing
DATASET_VERSIONfrompackaging.py, theproduct_naming_schemefunction is imported and run inGUNWmode for testing. prepare-for-delivery.ipynbmodified to accommodate changes toprepare_for_deliveryfunction indelivery_prep.py.
- Rather than importing
- Renamed
nc_packaging_template.jsontonc_packaging_template_gunw.json(no content changes) and addednc_packaging_template_coseis-sar.jsonwith modifications replacingunwrappedPhase(radians) withlosDisplacement(meters) forCOSEIS_SARproduct. Updatedread_netcdf_packaging_templateintemplates/__init__.pyto return the template corresponding to the specifiedproduct. rangePixelOffsetsandazimuthPixelOffsetsunits changed fromradtometerandinput_relative_pathchanged fromfilt_dense_offsets.geotofilt_dense_offsets_m.geoinadditional_layers.json.- Ampcor window size changed from 64x64 to 32x128 pixels in
topsapp_proc.py. This change was made to account for ground resolution differences in range/azimuth direction (2.3m/14m), making range/azimuth pixel offset outputs approximately square, rather than rectangular. - Updated
iono_processingfunction iniono_proc.pyto take and assignrange_looksandazimuth_looksas arguments based on CLI-definedoutput-resolution. This is necessary for iono layer resolution to match 30- and 90-meter products. Corresponding updates were made in__main__.pywhen callingiono_processing. - Updated download URLs for S1 AUX_CAL files from sar-mpc.eu to ASF-managed https://d3g9emy65n853h.cloudfront.net/ URLs. Fixes #218.
Fixed
- Code formatting updated to comply with Flake8 rules.
DockerizedTopsApp v0.6.0
Added
isce2_topsapp.__main__.gunw_slcnow accepts--reference-dateand--secondary-dateparameters as alternatives to
--reference-scenesand--secondary-scenes. When provided,gunw_slcwill process all Sentinel-1 IW SLC scenes for
the given date and--frame-idin order to generate an ARIA_S1_GUNW product.
DockerizedTopsApp v0.5.0
Added
--min-frame-coverageparameter togunw_slcentrypoint andisce2_topsapp.__main__:gunw_slc. Specifies a minimum
percent of the ARIA Frame that the intersection of reference/secondary scenes must cover. Jobs not meeting the given
threshold will raise an error rather than generating a GUNW product.- Pushed formatting changes
DockerizedTopsApp v0.4.0
Changed
- Use
s1_orbitsrather thanhyp3libto download Sentinel-1 orbits files inlocalize_orbits.download_orbits
Removed
- ESA username/password requirement; these credentials are no longer needed to download Sentinel-1 orbit files.
DockerizedTopsApp v0.3.8
Fixed
- Aux cal files are now distributed from new locations and have nesting that must be removed. (See PR from hyp3-isce2)
DockerizedTopsApp v0.3.7
- Updates dem-stitcher to 2.5.8 to ensure new (ARIA-managed) url for reading the Geoid EGM 2008. See this issue.
- Ensure version/docker build use python 3 as done here: https://github.com/dbekaert/RAiDER/blob/32697d2e4e6908b8feb3b81a1df30cb5f4e49a24/.github/workflows/build.yml#L16-L17
DockerizedTopsApp v0.3.6
- Updates dem-stitcher to 2.5.6 to which updated to a new url for reading the Geoid EGM 2008.
DockerizedTopsApp v0.3.5
Added
- Include
daskin environment.yml as it appears to not be correctly handled in pandera: unionai-oss/pandera#1525