askui/python-sdk
Enable AI to control your desktop, mobile and HMI devices
Combines vision-based UI element detection with agentic AI control, eliminating brittle selector dependencies across Windows, macOS, Linux, Android, and iOS. Supports pluggable AI models (Claude, Gemini, AskUI-hosted, or custom) alongside low-level commands, with built-in API caching and extensibility via Model Context Protocol for custom tools. Includes multi-step intent execution, screenshot analysis, and structured data extraction from UI interactions.
520 stars. Actively maintained with 115 commits in the last 30 days.
Stars
520
Forks
57
Language
Python
License
MIT
Category
Last pushed
Mar 19, 2026
Commits (30d)
115
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/askui/python-sdk"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.