PC Agent

PC Agent is an AI system developed by GAIR-NLP that facilitates the creation of autonomous digital agents by transferring human cognitive processes. It comprises three key components: PC Tracker, a lightweight infrastructure for collecting large-scale human-computer interaction data; a Cognition Completion post-processing pipeline that converts raw interaction data into cognitive trajectories; and a multi-agent system combining a planning agent for decision-making with a grounding agent for robust visual grounding. PC Agent aims to enable AI to perform complex digital tasks autonomously by learning from human interactions.