Skip to content

Releases: awslabs/agent-evaluation

v0.4.1

31 Mar 17:32
5d2784a

Choose a tag to compare

What's Changed

  • fix: add missing init files for new modules; fix spelling mistake… by @amznokapl in #109

Full Changelog: v0.4.0...v0.4.1

v0.4.0

11 Mar 14:24
b777598

Choose a tag to compare

What's Changed

  • feat: replace all claude3 specific impl with canonicalEvaluator that … by @amznokapl in #101
  • feat: cut release 0.4.0 by @amznokapl in #102

New Contributors

Full Changelog: v0.3.0...v0.4.0

v0.3.0

11 Dec 15:50

Choose a tag to compare

What's Changed

Added

  • Added pass rate metric to summary (#60)
  • Added support of session attributes for bedrock agent target([#77] (#77))
  • Added Target for Prompt Flows (#96)

Fixed

  • Bedrock agent required arguments documented as optional (#92)
  • Fix test result attribute in summary template (#90)

Changed

  • Renamed TestResult.success to TestResult.passed (#62)
  • Moved agenteval.TargetResponse to agenteval.targets.TargetResponse. Documentation for creating custom targets also updated to reflect this change (#62)
  • Renamed the target config type from bedrock-knowledgebase to bedrock-knowledge-base (#62)

New Contributors

Full Changelog: v0.2.0...v0.3.0

v0.2.0

13 May 21:14
4ee7e8a

Choose a tag to compare

Changed

  • Convert the q_business_user_id configuration as optional to support applications that require AWS IAM Identity Center (#56)
  • Changed TargetResponse to a top-level import (#57)

Fixed

  • Documentation for creating custom targets (#57)

v0.1.0

03 May 22:24
16f5c7b

Choose a tag to compare

Initial release.