Skip to content
Live
Trending storyDeveloping

Amazon SageMaker has released a model leaderboard.

1 reports1 outlets1 hour agoUpdate

The story so far

AI overview

Amazon SageMaker has released the JumpStart model leaderboard, comparing the quality, speed, and cost of over 70 models directly in SageMaker Studio through three benchmark tests: BIG-Bench Hard, GPQA Diamond, and MMLU-Pro, as well as performance-cost metrics.

AI-written from the reports · Updated 23 minutes ago

Coverage timeline

Follow the coverage to see every side of the story.

19 Nov
  1. AWS Machine Learning Blog
    Introducing the Amazon SageMaker JumpStart Model Leaderboard

    Amazon SageMaker JumpStart has released a model leaderboard, comparing the quality, speed, and cost of over 70 models directly in SageMaker Studio through three benchmark tests: BIG-Bench Hard, GPQA Diamond, and MMLU-Pro, as well as performance-cost metrics.

Heat over time

Not enough data yet to draw a trend.