ScreenAgent
Overview
ScreenAgent is research software that uses screenshots and a vision-language model to operate a desktop through mouse and keyboard actions.
Best For Professions:
ScreenAgent is research software that uses screenshots and a vision-language model to operate a desktop through mouse and keyboard actions.
Its controller repeats planning, action and reflection over a VNC desktop, with datasets and model-training components. The controller and model run in an environment configured by a researcher.
Set up a VNC desktop, Python/PyQt controller and compatible model endpoint or local inference. Developers secure access, supervise actions and adapt older model configurations to their environment.
Choose ScreenAgent for supervised research into visual desktop control. Use an isolated desktop and review its model license and configuration before extending it.
Product overview
Capabilities, pricing and fit
ScreenAgent is research software that uses screenshots and a vision-language model to operate a desktop through mouse and keyboard actions.
Information as of November 10, 2026
What it can do
- What it does
Its controller repeats planning, action and reflection over a VNC desktop, with datasets and model-training components. The controller and model run in an environment configured by a researcher.[1], [2]
- Setup and human role
Set up a VNC desktop, Python/PyQt controller and compatible model endpoint or local inference. Developers secure access, supervise actions and adapt older model configurations to their environment.[1], [2]
- Connections
VNC supplies desktop access, with an optional clipboard service and configurable model adapters. Connect applications through their desktop interface and configure access explicitly.[1], [2]
Where it fits best
Pricing and availability
The code is MIT licensed and the dataset Apache-2.0. Distributed model weights carry separate CogVLM terms, including commercial registration; inference, hardware and setup remain additional costs.[1], [2]
Platforms: Developer-managed application[1], [2]
Access: Set up a VNC desktop, Python/PyQt controller and compatible model endpoint or local inference. Developers secure access, supervise actions and adapt older model configurations to their environment.[1], [2]
Sources (2)
- github.com — product informationOfficial site · checked 2026-11-10
- raw.githubusercontent.com — product informationOfficial site · checked 2026-11-10
Autonomy level
81/100
Our subjective rating of how independently the product carries out its documented tasks, considering the human setup, input, approval and review it needs. This is not a measured success rate.
Comparisons
Custom Comparisons
Some of the use cases of ScreenAgent:
- Choose ScreenAgent for supervised research into visual desktop control. Use an isolated desktop and review its model license and configuration before extending it.
Loading Community Opinions...
Pricing model:
Code access:
Popularity level: 44%
Turn this profile into a trust signal
Show prospects that ScreenAgent has a public place where they can check product details, pricing, ratings, and reviews.
Build confidence
Give buyers a third-party profile to explore.
Reduce hesitation
Put validation beside your strongest CTA.
Earn discovery
Every badge links prospects to your listing.
Choose your style
Preview it, then copy the complete embed code.
Shows buyers where to validate your product, pricing, and reputation.
Plain HTML. No signup, script, or maintenance required.
AI Agent Store · Specialist AI agentsFor desktop automation teams
Your AI agent for visual computer-control automation.
Exploring ScreenAgent? For desktop automation teams, your own AI agent can map desktop processes, repair application handoffs, and verify desktop outcomes. Start with a setup tailored to this work.
- ✓ Map desktop processes
- ✓ Repair application handoffs
- ✓ Verify desktop outcomes
Tailored starting setup. Chat on our site. See the workflow and monthly plan.