AI agent operation software
The story so far
Claude 3.5 Sonnet uses computer with a public test version to let AI agents operate software, read interfaces, and click and input like humans. Browser agents can operate websites, desktop agents can control native applications, but it is necessary to pay attention to errors and slow running speed, and sensitive operations should be limited. Currently, GPT and Gemini also support computer use through compatible tools.
AI-written from the reports · Updated 6 hours ago
Coverage timeline
Follow the coverage to see every side of the story.
- Browser UseWhat Is Computer Use? How AI Agents Operate Software
Claude 3.5 Sonnet's computer use was launched in a public beta in October 2024, reading the interface through screenshots, DOM, and accessibility trees, allowing AI agents to click and input like humans. Browser agents can operate websites, and desktop agents can control native applications, but it is important to note errors and slow running speeds, and sensitive operations should be restricted. Currently, GPT and Gemini also support computer use through compatible tools.
Heat over time
- Now
- 5
- Peak
- 620 Nov, 02:00
- 24h change
- –
Hover or tap the chart to see each hour; use the arrow keys on a keyboard.