Individual Endpoint
| Application | Std_Dev(%) (Branch, Line) | Cost ($)(Devstral, o1) | LLM_Calls | HTTP_Requests | Time(min) |
|---|---|---|---|---|---|
| PetClinic | (5.2%, 1.3%) | 0.02, 4.8 | 437 | 211 | 13.4 |
| DayTrader | (0.3%, 0.4%) | 0.04, 3.7 | 180 | 179 | 32.4 |
| JPetStore | (1.6%, 0.2%) | 0.05, 5.1 | 218 | 269 | 12.2 |
| Restcountries | (1.6%, 0.1%) | 0.04, 4.3 | 229 | 422 | 21.7 |
| Feature-service | (0.7%, 0.5%) | 0.04, 11.4 | 389 | 185 | 14.7 |
| Genome-Nexus | (0.1%, 0.8%) | 0.06, 7.7 | 356 | 423 | 40.4 |
| LanguageTool | (0.1%, 0.1%) | 0.04, 4.1 | 27 | 13 | 1.5 |
Scenario-based Endpoint
| Application | Std_Dev(%) (Branch, Line) | Cost ($)(Devstral, o1) | LLM_Calls | HTTP_Requests | Time(min) |
|---|---|---|---|---|---|
| PetClinic | (7.6%, 1.4%) | 0.02, 2.3 | 128 | 15 | 3.7 |
| DayTrader | (2.4%, 5.1%) | 0.04, 4.6 | 213 | 33 | 10.1 |
| JPetStore | (0.0%, 2.6%) | 0.05, 6.4 | 187 | 24 | 7.2 |
| Restcountries | (3.8%, 3.4%) | 0.02, 3.2 | 148 | 19 | 5.9 |
| Feature-service | (1.8%, 2.3%) | 0.04, 4.2 | 136 | 29 | 5.2 |
| Genome-Nexus | (2.7%, 3.4%) | 0.05, 6.0 | 216 | 25 | 17 |