ITHome · AI·· 33 minutes ago
Google AI agent optimization with Harness increases task success rate by 8 times
Brief overview
By allowing the AI agent to gradually modify its own runtime framework and verify each modification, Google's AI agent increased task success rate from 5.0% to 40.0% in the SWE-bench Lite test, reaching 8 times the original level, with an average consumption of about 46,700 tokens per task.
Source: ITHome · AI · ithome.com