跳到正文
实时
Hugging Face Daily Papers·· 9 小时前65

InclusionMed:面向包容性医疗的 AI 评测基准

InclusionMed: Benchmarking AI for Inclusive Healthcare

要点速览

InclusionMed是一个开放性包容性医疗AI评测倡议,通过Atlas和Index逐步发布,旨在确保全球人民的多样化医疗需求指导医疗AI的发展方向和衡量标准。

正文

InclusionMed is an open evaluation initiative for inclusive healthcare. Through successive releases of the Atlas and Index, this open collaboration aims to ensure that the diverse healthcare needs of people worldwide guide how progress in medical AI is defined and measured.

The InclusionMed Atlas organizes benchmarks along two axes: healthcare role and AI capability. The role axis distinguishes patients and the public, healthcare professionals, and healthcare administration professionals; the capability axis distinguishes knowledge, reasoning, and agency. The Atlas design makes clear which healthcare needs are represented by the included benchmarks and where coverage remains limited.

The InclusionMed Index aggregates model results across the benchmarks included in the Atlas. In the initial release, each model's Index score is the equally weighted mean of its five benchmark scores. The Index also reports scores by healthcare role and AI capability, revealing differences in both model rankings and score levels.

来源: Hugging Face Daily Papers · huggingface.co