Conversation
- New tool: destine_retrieval_tool.py with two-step workflow: 1. search_destine_parameters: RAG semantic search over 82 DestinE parameters via Chroma vector store 2. retrieve_destine_data: download point time series via earthkit.data + polytope - Authentication via ~/.polytopeapirc token (from desp-authentication.py) - UI toggle for DestinE data with token file status check - DestinE test suite (pytest -m destine), skipped by default - Updated README with DestinE authentication instructions
Move os.chdir(REPO_ROOT) from module level to an autouse fixture that restores the original cwd after each test, preventing side effects on other test files that use relative paths.
… add utility scripts - Fix lat/lon swap in polytope request (was [lon, lat], now [lat, lon]) - Remove "keep date ranges SHORT" limits — default to full 2020-2039 period - Simplify intro_agent prompt - Add standalone DestinE download scripts (simple + parallel yearly) - Add ERA5 fetch script and test utilities
…ring - Guide data_analysis_agent to download ERA5/DestinE variables in parallel (all in one response) - Relax intro_agent exclusion rules to allow analysis instructions (download data, plot time series, compute statistics)
koldunovn
approved these changes
Mar 3, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add DestinE Climate DT Data Retrieval Tool
Summary
Adds live data retrieval from the Destination Earth (DestinE) Climate Digital Twin to ClimSight's data analysis agent. This enables on-demand download of high-resolution climate projection time series (SSP3-7.0, IFS-NEMO model, 2020–2039) for any point location, with 82 available climate parameters discoverable via RAG semantic search.
What's new
DestinE retrieval tool (
src/climsight/tools/destine_retrieval_tool.py)earthkit.data+ polytope API)~/.polytopeapirctoken file (obtained by runningdesp-authentication.py)Agent integration (
data_analysis_agent.py)use_destine_data: truein configUI integration (
streamlit_interface.py)Configuration (
config.yml)use_destine_datatoggledestine_settingssection (Chroma DB path, collection name)State management (
climsight_classes.py,sandbox_utils.py)destine_data_diranddestine_tool_responsefields in AgentStatedestine_data/directoryTesting
test/test_destine_tool.py— dedicated test suite (RAG search, data retrieval, end-to-end workflow, caching, error handling)destinemarker, skipped by default in normal pytest runspytest -m destine -vtest/conftest.py— auto-skip logic for destine-marked testsUtility scripts
src/climsight/scripts/download_destine_simple.py— single-request download examplesrc/climsight/scripts/download_destine_example.py— parallel yearly download with timingsrc/climsight/scripts/era5_fetch.py— ERA5 data fetch utilitytest/plot_destine_data.py— quick Zarr data inspection and plottingtest/era5_tool_manual.py— ERA5 tool manual testDocumentation
README.md— DestinE authentication instructions with links to destination-earth.eu and polytope-examplesCLIMATE_DATA_ARCHITECTURE.md— data architecture overviewRequirements
earthkit-datapackage (for polytope API access)langchain-chroma,chromadb,langchain-openai(for RAG parameter search)~/.polytopeapirctoken file (rundesp-authentication.pyto obtain)