Releases: awslabs/agent-evaluation
Releases · awslabs/agent-evaluation
v0.4.1
What's Changed
- fix: add missing init files for new modules; fix spelling mistake… by @amznokapl in #109
Full Changelog: v0.4.0...v0.4.1
v0.4.0
What's Changed
- feat: replace all claude3 specific impl with canonicalEvaluator that … by @amznokapl in #101
- feat: cut release 0.4.0 by @amznokapl in #102
New Contributors
- @amznokapl made their first contribution in #101
Full Changelog: v0.3.0...v0.4.0
v0.3.0
What's Changed
Added
- Added pass rate metric to summary (#60)
- Added support of session attributes for bedrock agent target([#77] (#77))
- Added Target for Prompt Flows (#96)
Fixed
- Bedrock agent required arguments documented as optional (#92)
- Fix test result attribute in summary template (#90)
Changed
- Renamed
TestResult.successtoTestResult.passed(#62) - Moved
agenteval.TargetResponsetoagenteval.targets.TargetResponse. Documentation for creating custom targets also updated to reflect this change (#62) - Renamed the target config
typefrombedrock-knowledgebasetobedrock-knowledge-base(#62)
New Contributors
- @dferguson992 made their first contribution in #60
- @johntelforduk made their first contribution in #65
- @dependabot made their first contribution in #61
- @Edai made their first contribution in #77
- @ifeojo made their first contribution in #85
- @rvernica made their first contribution in #90
- @suyinw made their first contribution in #92
- @athewsey made their first contribution in #96
- @markcole99 made their first contribution in #94
Full Changelog: v0.2.0...v0.3.0