UniPat AI has released a wet experiment prediction benchmark
The story so far
UniPat AI released the Science Prediction Universe (SPU) benchmark, containing 116 tasks and 4207 wet experiments, covering chemistry, materials science, biology, and medicine. The benchmark requires models to autonomously research and predict experimental results. Evaluation shows Claude Opus 5.5 averaged a score of 0.486, with only 34%-52% of tasks exceeding random levels, indicating there is still room for improvement in AI's wet experiment prediction capabilities. The SPU evaluation emphasizes the model's autonomous research process and prediction outcomes, providing a new standard for evaluating AI's scientific research capabilities.
AI-written from the reports · Updated 1 hour ago
Coverage timeline
Follow the coverage to see every side of the story.
- QbitAIUniPat AI launches the most stringent wet experiment prediction benchmark SPU, with cutting-edge models performing poorly
UniPat AI has released a new benchmark SPU, including 116 tasks and 4207 wet experiments, covering fields such as chemistry and materials science, requiring models to conduct autonomous research and predict experimental results. Evaluations show that Claude Opus 5.5 scored an average of 0.486, with only 34%-52% of tasks exceeding random levels, indicating that AI still has significant room for improvement in wet experiment prediction. The SPU evaluation emphasizes the model's autonomous research process and prediction performance, providing a new standard for evaluating AI research capabilities.
Heat over time
- Now
- 8
- Peak
- 914 Nov, 22:00
- 24h change
- –
Hover or tap the chart to see each hour; use the arrow keys on a keyboard.