Agent S

Agent S is an open-source framework for building and running “computer use” GUI agents that can autonomously operate a computer through an Agent-Computer Interface. It’s designed to let an LLM plan and execute multi-step tasks by observing the screen and taking actions (e.g., clicking, typing, navigating) on supported platforms (Linux, macOS, Windows). The project provides a CLI to run the agent, supports multiple model providers (including OpenAI, Anthropic, Gemini, OpenRouter, and vLLM), and recommends pairing a main LLM with a separate grounding model for UI understanding. Agent S also includes evaluation assets and reports results on established computer-use benchmarks such as OSWorld.