Tool directory · Automation
agent-desktop
Last checked
A Rust tool from Vercel Labs that lets agents operate desktop apps through the OS accessibility tree instead of screenshots.
Our Take
In its developers' words, it "sees any app's real UI structure through OS accessibility trees," so element references "stay stable and actions stay safe to retry, instead of guessing from pixels." Most computer-use agents still work from screenshots, so this is a different bet worth watching. It has been around since February 2026, and v1.0.2 shipped on Oct 30. Source