Skip to content
Live
Trending storyPast story

A financial intelligence agent open-world evaluation paradigm has been released.

1 reports1 outlets8 days agoUpdate

The story so far

AI overview

FINCOSMOS has introduced an open-world evaluation paradigm for evaluating intelligent agents in the financial field. In 150 simulated user interactions, no session was accepted because all sessions failed during program checks, with the agent reporting only 54-64% of the undisclosed details. Human experts attributed 88.33% of the failures to the agent.

AI-written from the reports · Updated 7 days ago

Coverage timeline

Follow the coverage to see every side of the story.

11 Nov
  1. Hugging Face Daily Papers
    FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance

    FINCOSMOS has introduced an open-world evaluation paradigm for evaluating intelligent agents in the financial field. In 150 simulated user interactions, no session was accepted because all sessions failed during program checks, with the agent reporting only 54-64% of the undisclosed details. Human experts attributed 88.33% of the failures to the agent.

Heat over time

Now
3
Peak
512 Nov, 06:00
24h change
-49%

Hover or tap the chart to see each hour; use the arrow keys on a keyboard.