nowickam/facial-animation
Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the animation
This project helps you create realistic lip movements on a digital avatar from an audio recording of human speech. You upload an audio file (like a .wav or .mp3) or record speech directly, and it generates the corresponding facial animation for a provided avatar. This is ideal for content creators, educators, or virtual assistant developers looking to add lifelike speech to digital characters.
No commits in the last 6 months.
Use this if you need to quickly generate synchronized lip movements for a digital character from an audio input without manual animation.
Not ideal if you need highly customized facial expressions beyond lip-syncing or require integrating with complex 3D animation software.
Stars
36
Forks
16
Language
Jupyter Notebook
License
—
Category
Last pushed
Jul 14, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/voice-ai/nowickam/facial-animation"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
met4citizen/TalkingHead
Talking Head (3D): A JavaScript class for real-time lip-sync using full-body 3D avatars.
livekit/livekit
End-to-end realtime stack for connecting humans and AI
Henry-23/VideoChat
实时交互数字人，可自定义形象与音色，支持音色克隆，对话延迟低至3s。Real-time voice interactive digital human, customizable...
dmisol/flexatar-virtual-webcam
Personalized Virtual Webcam for WebRTC
zslrmhb/Omniverse-Virtual-Assisstant
Audio2Face Avatar with Riva SDK functionality