Gesture Based Input Control ML Frameworks

Applications that use hand gestures, eye tracking, or body movements to control computer peripherals (mouse, keyboard, volume) and interact with desktop systems. Does NOT include gesture recognition for classification, sign language interpretation, or gaming gesture detection.

There are 27 gesture based input control frameworks tracked. The highest-rated is singharyans754/AI-Virtual-Mouse at 40/100 with 20 stars.

Get all 27 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=gesture-based-input-control&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Framework Score Tier
1 singharyans754/AI-Virtual-Mouse

An AI-based application which let us control the mouse cursor by moving...

40
Emerging
2 suixin1424/mouse_control

一种基于神经网络来模拟人手移动鼠标的方法

40
Emerging
3 SunOner/mouse_net

Mouse Movement Prediction Training Tool

39
Emerging
4 MatheusR42/yeelight-hand-controller

With Yeelight Hand Controller you can turn on and off your Yeelight just...

37
Emerging
5 VitorCarvalho67/Barium

Cutting-edge Python software utilizing neural networks and machine learning...

36
Emerging
6 charliegerard/splat

Motion-controlled Fruit Ninja clone using Three.js & Tensorflow.js

33
Emerging
7 developers-cosmos/COVID-Race-Game

A Game is developed with pygame and AI where the user can control the...

33
Emerging
8 gaurav-aditya/Computer-Automation

Computer Automation using OpenCv and MediaPipe - Virtually controlling...

30
Emerging
9 badboysm890/AirMice.Py

Control Mouse using Hand powered by Media Pipe Hand Tracking and Gesture...

29
Experimental
10 matzy-byte/magic-effects-ar

Demo for gesture controlled game using deep learning framework mediapipe

26
Experimental
11 Phonkich/gesture-mouse

🖐️ Control your mouse effortlessly with real-time hand gestures using AI and...

25
Experimental
12 Shell-Company/jutsu

Record hand gestures and use them to control your computer

24
Experimental
13 matheussiqueira-dev/Clone-Fruit-Ninja

Clone de Fruit Ninja com gameplay vertical (9:16), focado em gestos fluidos...

22
Experimental
14 zeroclutch/killingtime

A hand-tracking based game where you shoot pesky alarm clocks using finger guns.

22
Experimental
15 singhtejpreet2004/Virtual-Mouse-App

A Gesture-Driven Computer Navigation developed in python - Control Your...

21
Experimental
16 mlhtnc/gesture-controlled-snake-game

This is a snake game controlled by hand gestures

21
Experimental
17 HanSolo15e/HandTrakingMouse

Control Your Mouse with Mediapipe Handtracking in Python

21
Experimental
18 Vaibhav-kesarwani/Gesture-volume-detector

👋 Welcome to the Gesture Volume App Repository!

19
Experimental
19 andrijadukic/gesture-guesser

A simple whiteboard backed by a feedforward neural network for collecting,...

17
Experimental
20 ne3lakolkar/Hand-Tracking-using-MediaPipe

Hand tracking module trained by using PyCharm and Mediapipe library....

17
Experimental
21 aimaster-dev/pong-motion-control

This project is a hand-gesture-controlled Pong game using TensorFlow,...

14
Experimental
22 Bunty9/3d-pen

Smart pen that writes on real paper while streaming sensor data wirelessly...

13
Experimental
23 yinnyC/body-sound-control-MarioGame

Super Mario Web game - You can control the idle with your own body gesture...

11
Experimental
24 swapniltake1/AI-Project-Virtual-Mouse

This is a Computer Engineering 6th sem project. AI Based virtual Mouse

11
Experimental
25 rudra-chothe/Virtual-Keyboard-using-OpenCV

A virtual keyboard built using OpenCV and CvZone for gesture-based typing.

11
Experimental
26 khan-tahir/AI-Virtual-Mouse

Welcome to the realm of enchanting technology! The 'AI Virtual Mouse'...

11
Experimental
27 Anvith12/Ai-Virtual-Mouse

An AI-based application which let us control the mouse cursor by moving...

11
Experimental