#rust #accessibility #accessibility_api #ai_agents #automation #cli #computer_use #computer_use_agent #computer_use_agents #desktop_automation #macos #mcp #rust
agent-desktop lets AI agents see and control desktop apps on macOS, Windows, and Linux. It reads an app’s accessibility information and gives the agent references to elements it can click, type into, or otherwise operate. The agent can then check the result and continue. This makes it possible to automate desktop tasks without relying on screenshots or matching pixels. It is available as a command-line tool and a C library, and does not include an AI model.
https://github.com/vercel-labs/agent-desktop
agent-desktop lets AI agents see and control desktop apps on macOS, Windows, and Linux. It reads an app’s accessibility information and gives the agent references to elements it can click, type into, or otherwise operate. The agent can then check the result and continue. This makes it possible to automate desktop tasks without relying on screenshots or matching pixels. It is available as a command-line tool and a C library, and does not include an AI model.
https://github.com/vercel-labs/agent-desktop
GitHub
GitHub - vercel-labs/agent-desktop: Computer use CLI for AI agents
Computer use CLI for AI agents. Contribute to vercel-labs/agent-desktop development by creating an account on GitHub.