Amazon Bedrock AgentCore supports 15 built-in evaluators or custom evaluators
The story so far
Amazon Bedrock AgentCore Evaluations support scoring agents using 15 built-in evaluators or custom evaluators (LLM or code). Decision models are suitable for questions with a fixed set of answers, such as Jev and Strands Decider 2B, which provide calibrated probabilities rather than free text. The code example shows how to convert AgentCore evaluation input into a decision model request and convert model probabilities back into evaluation results.
AI-written from the reports · Updated 14 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- AWS Machine Learning BlogUse decision models with Amazon Bedrock AgentCore Evaluations
Amazon Bedrock AgentCore Evaluations support scoring agents using 15 built-in evaluators or custom evaluators (LLM or code). Decision models are suitable for questions with a fixed set of answers, such as Jev and Strands Decider 2B, which provide calibrated probabilities rather than free text. The code example shows how to convert AgentCore evaluation input into a decision model request and convert model probabilities back into evaluation results.