A financial intelligence agent open-world evaluation paradigm has been released.
The story so far
FINCOSMOS has introduced an open-world evaluation paradigm for evaluating intelligent agents in the financial field. In 150 simulated user interactions, no session was accepted because all sessions failed during program checks, with the agent reporting only 54-64% of the undisclosed details. Human experts attributed 88.33% of the failures to the agent.
AI-written from the reports · Updated 7 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersFINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance
FINCOSMOS has introduced an open-world evaluation paradigm for evaluating intelligent agents in the financial field. In 150 simulated user interactions, no session was accepted because all sessions failed during program checks, with the agent reporting only 54-64% of the undisclosed details. Human experts attributed 88.33% of the failures to the agent.
Heat over time
- Now
- 3
- Peak
- 512 Nov, 06:00
- 24h change
- -49%
Hover or tap the chart to see each hour; use the arrow keys on a keyboard.