SCRN-VRC/3D-Face-Landmark-in-UnityCG-HLSL
3D face landmark detection using MediaPipe's Facemesh and Iris tracking models
This project helps VR content creators and game developers incorporate realistic 3D face and eye tracking into their Unity projects. It takes a live camera feed of a user's face and outputs detailed 3D facial landmark data and blendshape values (like 'mouth open' or 'eye blink') within Unity. This enables the creation of expressive virtual avatars and interactive experiences that respond to a user's real facial movements.
124 stars. No commits in the last 6 months.
Use this if you are a Unity developer looking to integrate real-time 3D face and iris tracking into your mobile or VR applications using MediaPipe models.
Not ideal if you need highly accurate head rotation tracking or face detection that works reliably when the user's face is not centered in the camera.
Stars
124
Forks
18
Language
C++
License
Apache-2.0
Category
Last pushed
Dec 24, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/computer-vision/SCRN-VRC/3D-Face-Landmark-in-UnityCG-HLSL"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
stereolabs/zed-unity
ZED SDK Unity plugin
CMU-Perceptual-Computing-Lab/openpose_unity_plugin
OpenPose's Unity Plugin for Unity users
Unity-Technologies/com.unity.perception
Perception toolkit for sim2real training and validation in Unity
evo-biomech/replicAnt
replicAnt - generating annotated images of animals in complex environments with Unreal Engine
Unity-Technologies/SynthDet
SynthDet - An end-to-end object detection pipeline using synthetic data