Windows Agent Arena

Windows Agent Arena (WAA) is an open-source platform developed by Microsoft for evaluating multi-modal AI agents within a real Windows operating system environment. It provides a reproducible and realistic setting where agents can interact with various applications, tools, and web browsers, simulating typical user tasks. WAA includes over 150 diverse tasks across domains such as document editing, web browsing, system settings, coding, and media consumption. The platform supports scalable benchmarking, allowing parallel evaluations in Azure to expedite comprehensive assessments.