GUI Automation Agents
AI agents that control computer and mobile interfaces through visual understanding and direct GUI interaction (clicking, typing, screenshot analysis). Includes desktop, mobile, and device control. Does NOT include web scraping APIs, coding automation, or system command execution without GUI interaction.
There are 32 gui automation agents tracked. 2 score above 70 (verified tier). The highest-rated is trycua/cua at 82/100 with 13,043 stars and 764 monthly downloads. 4 of the top 10 are actively maintained.
Get all 32 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=agents&subcategory=gui-automation-agents&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Agent | Score | Tier |
|---|---|---|---|
| 1 |
trycua/cua
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and... |
|
Verified |
| 2 |
droidrun/droidrun
Automate your mobile devices with natural language commands - an LLM... |
|
Verified |
| 3 |
TurixAI/TuriX-CUA
This is the official website for TuriX Computer-use-Agent |
|
Established |
| 4 |
Haervwe/open-webui-tools
Open‑WebUI Tools is a modular toolkit designed to extend and enrich your... |
|
Established |
| 5 |
erickjtorres/app-use
📱 Make apps accessible for AI agents |
|
Established |
| 6 |
coasty-ai/open-computer-use
The Open Framework for autonomous virtual computer agents at scale, fully... |
|
Established |
| 7 |
Turbo1123/roubao
Android Automation Tool Based on Vision-Language Models |
|
Emerging |
| 8 |
FilipFan/AppFunctionsPilot
A sample that showcases Android App Functions use cases. |
|
Emerging |
| 9 |
Mohsinmjr/roubao
🤖 Automate your Android tasks seamlessly with Roubao, the first open-source... |
|
Emerging |
| 10 |
rafalwytrykus/py2mac
A Python Interface to macOS Accessibility API for UI Automation and AI Agents. |
|
Emerging |
| 11 |
shyamsridhar123/MultiAgent-CUA
Multi-Agent Vision-Driven Automation Showcase: CUA + Playwright + LangChain |
|
Emerging |
| 12 |
Y-0023/cua
c/ua is the Docker Container for Computer-Use AI Agents. |
|
Experimental |
| 13 |
Codeeaner/Computer-Use-Agent
An AI Agent that is able to control your screen to complste any task |
|
Experimental |
| 14 |
memohai/Auto-Fish
An AI Agent tool to automate Android devices reliably |
|
Experimental |
| 15 |
Osodyssey/Jumplander-AI-3D-Earth-Explorer
3D Earth Explorer is an interactive, fully-rendered 3D globe using Three.js.... |
|
Experimental |
| 16 |
labclaw/device-use
Like browser-use, but for scientific instruments — let AI agents operate any... |
|
Experimental |
| 17 |
Wintyx57/x402-autogpt-plugin
Auto-GPT plugin for x402 Bazaar - Autonomous API marketplace with USDC... |
|
Experimental |
| 18 |
kaimhosen/Open-AutoGLM
🤖 Automate your mobile tasks with Phone Agent, a smart assistant framework... |
|
Experimental |
| 19 |
YogurtJ/wechat-devtools-automator
MIT-licensed beta WeChat DevTools automation for agentic Mini Program... |
|
Experimental |
| 20 |
sumanthnani10/PocketPilot
PocketPilot: An open-source framework for Android automation and mobile RPA.... |
|
Experimental |
| 21 |
DmitrL-dev/Open-AutoGLM-Russian-version
brain for mobile device |
|
Experimental |
| 22 |
lanbodikai/mouse-fit
MVP of the mouse & grip finder(Web Version in link). Its a simple tool that... |
|
Experimental |
| 23 |
BrAtUkA/Computer-Use-Agent
A local VLM-powered agent that controls your computer through natural... |
|
Experimental |
| 24 |
dsadsasdaddas/webcatch
🔍 垂直领域商业舆情深度分析 Agent - AI-powered business sentiment analysis tool with... |
|
Experimental |
| 25 |
star8909/DroidAI-public
DroidAI - AI-Powered Android Device Controller. Let AI see your screen and... |
|
Experimental |
| 26 |
Rajathbharadwaj/LangGraph-Computer-Use-Open-Source
🤖 Open-source Computer Use Agent - Control any computer with AI vision. Free... |
|
Experimental |
| 27 |
djcgh/AdbPhoneAgent
用自然语言控制 Android 手机的 AI Agent —— 基于 UI 结构树解析实现快速精准操控，截图视觉理解作为辅助，支持接入任意大语言模型。 |
|
Experimental |
| 28 |
devXjitin/Computer-Use-Agent
An AI agent capable of interacting with computer interfaces, executing... |
|
Experimental |
| 29 |
bevren/aua
Android Use Agent |
|
Experimental |
| 30 |
AmorceAATP/autogpt-amorce-plugin
🤖 AutoGPT plugin for Amorce - Zero-config cryptographic security |
|
Experimental |
| 31 |
arvindrk/computer-use-agent
An autonomous, multimodal AI agent that controls a live Linux virtual... |
|
Experimental |
| 32 |
dakariuishmg/Uish_Warhol_Cube_v1
Web Browser UI | Interactive 3D cube with six draggable HTML faces,... |
|
Experimental |