Limitations in AI's understanding of culture
The story so far
Cohere Labs conducted a global collaboration to test AI models with cultural puzzles, discovering significant flaws in cross-language cultural understanding, often answering incorrectly or generating hallucinations. Participants included over 100 people from more than 50 countries, including 16-year-old American student Henry Gagnier and retired teacher Jane Smith, who pointed out that the model not only lacks cultural knowledge but is almost ignorant of common languages like Buginese.
AI-written from the reports · Updated 26 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Cohere BlogCan AI understand culture?
Cohere Labs open-source science project collects cultural puzzles through global collaboration to test AI models, finding significant flaws in cross-linguistic cultural understanding, often answering incorrectly or hallucinating. Participants include over 100 people from more than 50 countries, including 16-year-old American student Henry Gagnier and retired teacher Jane Smith, who provided key insights, pointing out that the model not only lacks cultural knowledge but is almost clueless about common languages like Buginese.