Hand Gesture Control ML Frameworks

Applications that detect hand and eye gestures to control external systems (streaming platforms, games, AR experiences). Does NOT include general hand detection libraries, sign language recognition, or pose estimation frameworks.

There are 16 hand gesture control frameworks tracked. The highest-rated is despoisj/DeepEyeControl at 38/100 with 119 stars.

Get all 16 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=hand-gesture-control&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	despoisj/DeepEyeControl Using your eyes to trigger shortcuts on your computer	38	Emerging	119	Python
2	Eric-Canas/Drums-app Play drums in your browser with your webcam	35	Emerging	11	JavaScript
3	instrumentbible/solfege.ai Detect solfege hand signs using machine learning ✋ 🎹	29	Experimental	16	JavaScript
4	mauricioromagnollo/gesture-video-controller Controlling Streaming Platforms using Eye and Hand Detection.	29	Experimental	1	JavaScript
5	wangqianwen0418/tfjs-webcam-ML-PACMAN Teach an ML model to read your gestures in your web browser	24	Experimental	1	JavaScript
6	plxity/Drums-with-hand-recognition Virtual drumkit but fingers as a drum stick	22	Experimental	6	JavaScript
7	Deepakr136/Real-time-finger-counter-application 🐙 Real-time finger counter app using webcam, OpenCV and MediaPipe with a...	22	Experimental	—	Python
8	mbagatini/js-expert-node-stream S Expert Week 7.0 - Controlling Streaming Platforms using Eye and Hand Detection 👁🖐	21	Experimental	1	JavaScript
9	Vaibhav-kesarwani/Finger-Counter 👋 Welcome to the Finger Counting App Repository!	19	Experimental	3	Python
10	mehdirzfx/HandDetection python algorithm for detect hands by Artificial Intelligence	18	Experimental	2	Python
11	shweshi/slap-on-face Fun Eel Slap! project with a twist. You can use your hand to slap the eel....	17	Experimental	1	JavaScript
12	PrinceP/legendary-octo-goggles AR app for counting	17	Experimental	1	Jupyter Notebook
13	kyuchukova13-bit/sabirane-i-izvajdane-do-100 Иновативен образователен тренажор по математика , използващ изкуствен...	13	Experimental	—	HTML
14	Tai-Min/Capacitive-Pattern-Based-Input-Lock Reinvent low power user's input using PSoC4100s reliable capticive...	11	Experimental	—	C++
15	AnthLima/fingerpose-detection-two-hands The goal here is to warm up for one of the js expert weeks, and also learn...	11	Experimental	—	JavaScript
16	xylvnking/xk-tensorflow-threejs-hand-detection 3D object manipulation in-browser using TensorFlow's hand pose detection...	10	Experimental	2	JavaScript