#rust #accessibility #accessibility_api #ai_agents #automation #cli #computer_use #computer_use_agent #computer_use_agents #desktop_automation #macos #mcp #rust

agent-desktop lets AI agents see and control desktop apps on macOS, Windows, and Linux. It reads an app’s accessibility information and gives the agent references to elements it can click, type into, or otherwise operate. The agent can then check the result and continue. This makes it possible to automate desktop tasks without relying on screenshots or matching pixels. It is available as a command-line tool and a C library, and does not include an AI model.

https://github.com/vercel-labs/agent-desktop