Skip to content
Live
Hugging Face Daily Papers·· 9 hours ago65

InclusionMed: Benchmarking AI for Inclusive Healthcare

InclusionMed: Benchmarking AI for Inclusive Healthcare

Brief overview

InclusionMed is an open and inclusive medical AI evaluation initiative, gradually released through Atlas and Index, aiming to guide the development direction and metrics of medical AI based on the diverse healthcare needs of people worldwide.

Article

InclusionMed is an open evaluation initiative for inclusive healthcare. Through successive releases of the Atlas and Index, this open collaboration aims to ensure that the diverse healthcare needs of people worldwide guide how progress in medical AI is defined and measured.

The InclusionMed Atlas organizes benchmarks along two axes: healthcare role and AI capability. The role axis distinguishes patients and the public, healthcare professionals, and healthcare administration professionals; the capability axis distinguishes knowledge, reasoning, and agency. The Atlas design makes clear which healthcare needs are represented by the included benchmarks and where coverage remains limited.

The InclusionMed Index aggregates model results across the benchmarks included in the Atlas. In the initial release, each model's Index score is the equally weighted mean of its five benchmark scores. The Index also reports scores by healthcare role and AI capability, revealing differences in both model rankings and score levels.

Source: Hugging Face Daily Papers · huggingface.co