Conversation
| steps: | ||
| - uses: actions/checkout@v4 | ||
|
|
||
| - name: Free Disk Space |
There was a problem hiding this comment.
this will probably make these take much longer... i can take a look at it too see if theres another way to do this without using up a bunch of space
have you noticed it taking longer with this line?
There was a problem hiding this comment.
I think you are right and it takes longer. So definitely worth taking a look. Thanks a lot @johnwalz97
PR SummaryThis PR introduces several functional changes and enhancements:
Test Suggestions
|
Pull Request Description
What and why?
What
Updated test result description generation to include both figures and tables simultaneously. Previously, figures were excluded when tables were present (
[] if tables else figures); now both are included when available.Why
Tests often return both tabular data and visualizations. Excluding figures when tables exist limited the LLM’s ability to analyze both. Including both enables richer, more complete descriptions that combine insights from tables and figures.
How to test
Run a test that outputs both figures and tables, e.g.,
ClassImbalanceand check that both figures and tables are included in the user message. You can check this by inspecting the trace in the Langfuselocalproject.What needs special review?
Everything seems to work fine when including both, so I’m not sure whether excluding figures when tables are present was a deliberate choice.
Dependencies, breaking changes, and deployment notes
Release notes
Checklist