Skip to content
Live
Trending storyPast story

Amazon and AVERI strengthen AI security assessment

1 reports1 outlets29 days agoUpdate

The story so far

AI overview

Amazon partnered with AVERI to review AI safety assessment datasets, confirming the comprehensiveness, diversity, and low contamination risk of the assessment process, but also found room for improvement in language style, attack complexity, and assessment timeliness. Amazon updated the test set based on feedback, introduced a difficulty grading framework, established a quarterly review mechanism, and expanded language coverage. This is regarded as the best practice for evaluating the quality of AI safety processes.

AI-written from the reports · Updated 27 days ago

Coverage timeline

Follow the coverage to see every side of the story.

21 Oct
  1. Amazon Science
    Strengthening AI safety evaluation through independent third-party review

    Amazon collaborates with AVERI to independently review internal security assessment datasets, verifying the comprehensiveness, diversity, and low contamination risk of the assessment process, but also found room for improvement in language style, attack complexity, and assessment timeliness. Amazon has updated the test set based on feedback, introduced a difficulty grading framework, established a quarterly review mechanism, and expanded language coverage, which is seen as the best practice for evaluating the quality of AI security assessment processes.