Gesture Based Input Control ML Frameworks
Applications that use hand gestures, eye tracking, or body movements to control computer peripherals (mouse, keyboard, volume) and interact with desktop systems. Does NOT include gesture recognition for classification, sign language interpretation, or gaming gesture detection.
There are 32 gesture based input control frameworks tracked. The highest-rated is singharyans754/AI-Virtual-Mouse at 33/100 with 20 stars.
Get all 32 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=gesture-based-input-control&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Framework | Score | Tier |
|---|---|---|---|
| 1 |
singharyans754/AI-Virtual-Mouse
An AI-based application which let us control the mouse cursor by moving... |
|
Emerging |
| 2 |
suixin1424/mouse_control
一种基于神经网络来模拟人手移动鼠标的方法 |
|
Emerging |
| 3 |
SunOner/mouse_net
Mouse Movement Prediction Training Tool |
|
Emerging |
| 4 |
MatheusR42/yeelight-hand-controller
With Yeelight Hand Controller you can turn on and off your Yeelight just... |
|
Emerging |
| 5 |
VitorCarvalho67/Barium
Cutting-edge Python software utilizing neural networks and machine learning... |
|
Experimental |
| 6 |
omana1/Motion-controlled-3D-game
🍉 3D Fruit Slicer Game with PoseNet & Three.js An experimental browser-based... |
|
Experimental |
| 7 |
developers-cosmos/COVID-Race-Game
A Game is developed with pygame and AI where the user can control the... |
|
Experimental |
| 8 |
charliegerard/splat
Motion-controlled Fruit Ninja clone using Three.js & Tensorflow.js |
|
Experimental |
| 9 |
Phonkich/gesture-mouse
🖐️ Control your mouse effortlessly with real-time hand gestures using AI and... |
|
Experimental |
| 10 |
gaurav-aditya/Computer-Automation
Computer Automation using OpenCv and MediaPipe - Virtually controlling... |
|
Experimental |
| 11 |
Niharikaa08/Aircanvas
Real-time hand-gesture drawing app using OpenCV and MediaPipe. Wave your... |
|
Experimental |
| 12 |
sspathak/eye-mouse
Control your PC's mouse by just looking at the screen! |
|
Experimental |
| 13 |
badboysm890/AirMice.Py
Control Mouse using Hand powered by Media Pipe Hand Tracking and Gesture... |
|
Experimental |
| 14 |
matzy-byte/magic-effects-ar
Demo for gesture controlled game using deep learning framework mediapipe |
|
Experimental |
| 15 |
matheussiqueira-dev/Clone-Fruit-Ninja
Clone de Fruit Ninja com gameplay vertical (9:16), focado em gestos fluidos... |
|
Experimental |
| 16 |
ayanrasulova/Thistle
[Girls Who Hack 2025 Winner] Re-imagining digital art accessibility by... |
|
Experimental |
| 17 |
SusmoyNath/Motion-controlled-3D-game
🍉 3D Fruit Slicer Game with PoseNet & Three.js An experimental browser-based... |
|
Experimental |
| 18 |
Shell-Company/jutsu
Record hand gestures and use them to control your computer |
|
Experimental |
| 19 |
zeroclutch/killingtime
A hand-tracking based game where you shoot pesky alarm clocks using finger guns. |
|
Experimental |
| 20 |
archi-med3/HandMirror-AI
Real-time control of a robotic hand using AI and a webcam, powered by... |
|
Experimental |
| 21 |
MoxzzyK/Antimicro
Antimicro is a graphical program used to map keyboard keys and mouse... |
|
Experimental |
| 22 |
HanSolo15e/HandTrakingMouse
Control Your Mouse with Mediapipe Handtracking in Python |
|
Experimental |
| 23 |
mlhtnc/gesture-controlled-snake-game
This is a snake game controlled by hand gestures |
|
Experimental |
| 24 |
singhtejpreet2004/Virtual-Mouse-App
A Gesture-Driven Computer Navigation developed in python - Control Your... |
|
Experimental |
| 25 |
Orionagappe/MistTracker
Collaborative nD simulator |
|
Experimental |
| 26 |
Vaibhav-kesarwani/Gesture-volume-detector
👋 Welcome to the Gesture Volume App Repository! |
|
Experimental |
| 27 |
Bhuvneshn/GestureMario
A cross-browser Mario game that can be played using hand gestures |
|
Experimental |
| 28 |
Bunty9/3d-pen
Smart pen that writes on real paper while streaming sensor data wirelessly... |
|
Experimental |
| 29 |
mustafaozvardar/Virtual-Drag-Drop-OpenCV
In this project, we developed a hand tracking application that allows users... |
|
Experimental |
| 30 |
andrijadukic/gesture-guesser
A simple whiteboard backed by a feedforward neural network for collecting,... |
|
Experimental |
| 31 |
ne3lakolkar/Hand-Tracking-using-MediaPipe
Hand tracking module trained by using PyCharm and Mediapipe library.... |
|
Experimental |
| 32 |
argav304/AI-Gaming-Controller
A Gaming Controller for Motorcycle games which uses AI and video feed to... |
|
Experimental |