Skip to content
Live
Trending storyPast story

Amazon Bedrock AgentCore supports 15 built-in evaluators or custom evaluators

1 reports1 outlets14 days agoUpdate

The story so far

AI overview

Amazon Bedrock AgentCore Evaluations support scoring agents using 15 built-in evaluators or custom evaluators (LLM or code). Decision models are suitable for questions with a fixed set of answers, such as Jev and Strands Decider 2B, which provide calibrated probabilities rather than free text. The code example shows how to convert AgentCore evaluation input into a decision model request and convert model probabilities back into evaluation results.

AI-written from the reports · Updated 14 days ago

Coverage timeline

Follow the coverage to see every side of the story.

5 Nov
  1. AWS Machine Learning Blog
    Use decision models with Amazon Bedrock AgentCore Evaluations

    Amazon Bedrock AgentCore Evaluations support scoring agents using 15 built-in evaluators or custom evaluators (LLM or code). Decision models are suitable for questions with a fixed set of answers, such as Jev and Strands Decider 2B, which provide calibrated probabilities rather than free text. The code example shows how to convert AgentCore evaluation input into a decision model request and convert model probabilities back into evaluation results.