GUI Automation Agents
AI agents that control computer and mobile interfaces through visual understanding and direct GUI interaction (clicking, typing, screenshot analysis). Includes desktop, mobile, and device control. Does NOT include web scraping APIs, coding automation, or system command execution without GUI interaction.
There are 30 gui automation agents tracked. 1 score above 70 (verified tier). The highest-rated is droidrun/droidrun at 79/100 with 7,932 stars. 4 of the top 10 are actively maintained.
Get all 30 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=agents&subcategory=gui-automation-agents&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Agent | Score | Tier |
|---|---|---|---|
| 1 |
droidrun/droidrun
Automate your mobile devices with natural language commands - an LLM... |
|
Verified |
| 2 |
trycua/cua
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and... |
|
Established |
| 3 |
TurixAI/TuriX-CUA
This is the official website for TuriX Computer-use-Agent |
|
Established |
| 4 |
Haervwe/open-webui-tools
Open‑WebUI Tools is a modular toolkit designed to extend and enrich your... |
|
Established |
| 5 |
erickjtorres/app-use
📱 Make apps accessible for AI agents |
|
Established |
| 6 |
coasty-ai/open-computer-use
The Open Framework for autonomous virtual computer agents at scale, fully... |
|
Emerging |
| 7 |
Turbo1123/roubao
Android Automation Tool Based on Vision-Language Models |
|
Emerging |
| 8 |
FilipFan/AppFunctionsPilot
A sample that showcases Android App Functions use cases. |
|
Emerging |
| 9 |
rafalwytrykus/py2mac
A Python Interface to macOS Accessibility API for UI Automation and AI Agents. |
|
Experimental |
| 10 |
shyamsridhar123/MultiAgent-CUA
Multi-Agent Vision-Driven Automation Showcase: CUA + Playwright + LangChain |
|
Experimental |
| 11 |
Mohsinmjr/roubao
🤖 Automate your Android tasks seamlessly with Roubao, the first open-source... |
|
Experimental |
| 12 |
memohai/Auto-Fish
An AI Agent tool to automate Android devices reliably |
|
Experimental |
| 13 |
labclaw/device-use
Like browser-use, but for scientific instruments — let AI agents operate any... |
|
Experimental |
| 14 |
Wintyx57/x402-autogpt-plugin
Auto-GPT plugin for x402 Bazaar - Autonomous API marketplace with USDC... |
|
Experimental |
| 15 |
kaimhosen/Open-AutoGLM
🤖 Automate your mobile tasks with Phone Agent, a smart assistant framework... |
|
Experimental |
| 16 |
YogurtJ/wechat-devtools-automator
MIT-licensed beta WeChat DevTools automation for agentic Mini Program... |
|
Experimental |
| 17 |
Codeeaner/Computer-Use-Agent
An AI Agent that is able to control your screen to complste any task |
|
Experimental |
| 18 |
Y-0023/cua
c/ua is the Docker Container for Computer-Use AI Agents. |
|
Experimental |
| 19 |
sumanthnani10/PocketPilot
PocketPilot: An open-source framework for Android automation and mobile RPA.... |
|
Experimental |
| 20 |
Osodyssey/Jumplander-AI-3D-Earth-Explorer
3D Earth Explorer is an interactive, fully-rendered 3D globe using Three.js.... |
|
Experimental |
| 21 |
DmitrL-dev/Open-AutoGLM-Russian-version
brain for mobile device |
|
Experimental |
| 22 |
lanbodikai/mouse-fit
MVP of the mouse & grip finder(Web Version in link). Its a simple tool that... |
|
Experimental |
| 23 |
djcgh/AdbPhoneAgent
用自然语言控制 Android 手机的 AI Agent —— 基于 UI 结构树解析实现快速精准操控，截图视觉理解作为辅助，支持接入任意大语言模型。 |
|
Experimental |
| 24 |
devXjitin/Computer-Use-Agent
An AI agent capable of interacting with computer interfaces, executing... |
|
Experimental |
| 25 |
dsadsasdaddas/webcatch
🔍 垂直领域商业舆情深度分析 Agent - AI-powered business sentiment analysis tool with... |
|
Experimental |
| 26 |
star8909/DroidAI-public
DroidAI - AI-Powered Android Device Controller. Let AI see your screen and... |
|
Experimental |
| 27 |
dakariuishmg/Uish_Warhol_Cube_v1
Web Browser UI | Interactive 3D cube with six draggable HTML faces,... |
|
Experimental |
| 28 |
BrAtUkA/Computer-Use-Agent
A local VLM-powered agent that controls your computer through natural... |
|
Experimental |
| 29 |
arvindrk/computer-use-agent
An autonomous, multimodal AI agent that controls a live Linux virtual... |
|
Experimental |
| 30 |
Rajathbharadwaj/LangGraph-Computer-Use-Open-Source
🤖 Open-source Computer Use Agent - Control any computer with AI vision. Free... |
|
Experimental |