Amazon and AVERI strengthen AI security assessment
The story so far
Amazon partnered with AVERI to review AI safety assessment datasets, confirming the comprehensiveness, diversity, and low contamination risk of the assessment process, but also found room for improvement in language style, attack complexity, and assessment timeliness. Amazon updated the test set based on feedback, introduced a difficulty grading framework, established a quarterly review mechanism, and expanded language coverage. This is regarded as the best practice for evaluating the quality of AI safety processes.
AI-written from the reports · Updated 27 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Amazon ScienceStrengthening AI safety evaluation through independent third-party review
Amazon collaborates with AVERI to independently review internal security assessment datasets, verifying the comprehensiveness, diversity, and low contamination risk of the assessment process, but also found room for improvement in language style, attack complexity, and assessment timeliness. Amazon has updated the test set based on feedback, introduced a difficulty grading framework, established a quarterly review mechanism, and expanded language coverage, which is seen as the best practice for evaluating the quality of AI security assessment processes.