Speech Emotion Recognition ML Frameworks

Systems for classifying emotional states and affective expressions from audio speech signals using machine learning. Does NOT include general speech recognition, text-based sentiment analysis, facial emotion detection, or multi-modal systems without speech as primary input.

There are 62 speech emotion recognition frameworks tracked. 5 score above 50 (established tier). The highest-rated is MiteshPuthran/Speech-Emotion-Analyzer at 51/100 with 1,403 stars.

Get all 62 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=speech-emotion-recognition&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	MiteshPuthran/Speech-Emotion-Analyzer The neural network model is capable of detecting five different male/female...	51	Established	1,403	Jupyter Notebook
2	maelfabien/Multimodal-Emotion-Recognition A real time Multimodal Emotion Recognition web app for text, sound and video inputs	51	Established	1,072	Jupyter Notebook
3	x4nth055/emotion-recognition-using-speech Building and training Speech Emotion Recognizer that predicts human emotions...	51	Established	672	Python
4	marcogdepinto/emotion-classification-from-audio-files Understanding emotions from audio files using neural networks and multiple datasets.	51	Established	432	Python
5	xiamx/awesome-sentiment-analysis 😀😄😂😭 A curated list of Sentiment Analysis methods, implementations and misc. 😥😟😱😤	50	Established	931	—
6	IliaZenkov/transformer-cnn-emotion-recognition Speech Emotion Classification with novel Parallel CNN-Transformer model...	48	Emerging	266	Jupyter Notebook
7	aniemore/Aniemore Emotions recognition from audio and text files (only russian language)	48	Emerging	79	Python
8	yeyupiaoling/SpeechEmotionRecognition-PaddlePaddle 语音感情识别	47	Emerging	44	Python
9	amanbasu/speech-emotion-recognition Detecting emotions using MFCC features of human speech using Deep Learning	47	Emerging	133	Jupyter Notebook
10	ankurbhatia24/MULTIMODAL-EMOTION-RECOGNITION Human Emotion Understanding using multimodal dataset.	45	Emerging	110	Jupyter Notebook
11	audeering/w2v2-how-to How to use our public wav2vec2 dimensional emotion model	43	Emerging	542	Jupyter Notebook
12	benkhelifamohamedtaher/speech-emotion-recognition Deep learning system for emotion recognition from speech, achieving 50.5%...	43	Emerging	9	Python
13	Mozartuss/DEAP-Emotion-Recognition Emotion Recogniton LSTM RNN Arousal Valence	40	Emerging	63	Python
14	Alex9104/face-mood-analyzer Face Mood Analyzer is an AI application that detects emotions in photos and...	40	Emerging	3	Python
15	MeidanGR/SpeechEmotionRecognition_Realtime Speech Emotion Recognition (SER) in real-time, using Deep Neural Networks...	38	Emerging	115	Jupyter Notebook
16	AryaAftab/LIGHT-SERNET Light-SERNet: A lightweight fully convolutional neural network for speech...	37	Emerging	83	Python
17	Hannibal0420/Speech-Emotion-Recognition-TinyML Speech Emotion Recognition using TinyML	36	Emerging	14	C++
18	sotirismos/emotion-recognition-conversations Diploma thesis analyzing emotion recognition in conversations exploiting...	35	Emerging	28	Python
19	abikaki/awesome-speech-emotion-recognition 😎 Awesome lists about Speech Emotion Recognition	34	Emerging	101	—
20	DaltonWemer/emotion-detection-system Using machine learning we are building an application to determine the...	32	Emerging	1	JavaScript
21	ZionC27/Speech-Emotion-Recognition Speech Emotion Recognition (SER) using Deep neural networks CNN and RNN	32	Emerging	6	Jupyter Notebook
22	billy-enrizky/Speech-Emotion-Recognition This project focuses on real-time Speech Emotion Recognition (SER) using the...	30	Emerging	2	HTML
23	purnima99/EmotionDetection Emotion Detection in Audio Files - Speech & Songs. A deep learning model...	30	Emerging	23	Python
24	spaghettiSystems/serval SER Evals: In-Domain and Out-of-Domain Benchmarking for Speech Emotion Recognition	28	Experimental	11	Python
25	EsratMaria/Speech_Emotion_Recognition_Model A speech emotion detection classifier on CREMA dataset. This classifier...	27	Experimental	10	Jupyter Notebook
26	AnkushMalaker/speech-emotion-recognition Implementation of the paper "Speech emotion recognition with deep...	27	Experimental	13	PureBasic
27	VyetGokyra/Speech_project_Vin Multimodal Speech Emotion Recognition ViT (AST) for audio encoder and...	26	Experimental	7	Python
28	cloor/Speech-Emotion-Recognition-ROS For Korean speech emotion detect, this model is trained by Korean dataset....	25	Experimental	8	Jupyter Notebook
29	MeshalAlamr/speech-emotion-recognition Detecting emotions from speech signals using a CNN model. Signal processing...	24	Experimental	4	Jupyter Notebook
30	Nightey3s/Speech-Emotion-Recognition-using-Wav2Vec2 A Speech Emotion Recognition (SER) system using Facebook's Wav2Vec2 model...	24	Experimental	3	Jupyter Notebook
31	Rahafzsh/SpeechEmotionsRecognition Deep Learning models are used for audio emotion classification for six...	24	Experimental	3	Jupyter Notebook
32	Neethuharii/Scream-Detection Human Scream Detection and Analysis for Controlling Crime Rate using Machine...	24	Experimental	4	Jupyter Notebook
33	hntrang04/bigdata-negative-speech-emotion-recognition Evaluating deep learning models for negative speech emotion recognition on...	22	Experimental	1	HTML
34	jake-chambers/eMotionaL 4th year capstone project that predicts the users emotions based on vocal analysis	21	Experimental	1	JavaScript
35	LEYA-HSE/BiBiER BiBiER: A Bilingual Bimodal Emotion Recognition Method with Improved...	21	Experimental	3	—
36	DiegoPaniagua23/multimodal-analysis-MIR Multimodal Data Analysis for Music Information Retrieval	20	Experimental	3	Jupyter Notebook
37	bolajixi/Mulitimodal-Speech-Emotion-Recognition A Tensorflow implementation of Speech Emotion Recognition using Audio...	19	Experimental	12	Jupyter Notebook
38	souradeepdutta/Speech-Emotion-Recognition-with-CNN-LSTM-CLSTM his is a Speech Emotion Recognition system that classifies emotions from...	19	Experimental	3	Jupyter Notebook
39	AhsanAkhlaq/EmotionRecoginationFromSpeech An advanced Speech Emotion Recognition (SER) system built using LSTM Neural...	18	Experimental	1	HTML
40	thejagadeesh/EMOTION-FUSION EmotionFusion: Multi-Modal Emotion Recognition Platform	18	Experimental	1	—
41	SCIFER99/Training-Emotion-Detection-Systems This program consists of an Emotion Detection Training System written in Python!	18	Experimental	2	Python
42	RajatYadav01/emotion-detection-using-speech-dialogue Detect emotion in a speech dialogue given as an input.	17	Experimental	1	JavaScript
43	farwa-shaikh/Deep-Learning-Emotion-Detection-Model This project aims to detect emotions from speech using deep learning models....	16	Experimental	4	Jupyter Notebook
44	Rayyan9477/speech_emotion_classification This project implements a speech emotion classification system using neural...	16	Experimental	4	HTML
45	petro-byte/video-va-regression Reproducible research pipeline for valence–arousal regression on the...	15	Experimental	1	Python
46	MukundaKatta/emotionmap EmotionMap — AI Affective Computing. Multi-modal emotion recognition from...	14	Experimental	—	Python
47	SepAbs/Emotion-based-Multilingual-Music-Classification Classifies multilingual music tracks based on emotions using audio and lyric...	14	Experimental	1	—
48	aliahmad552/speech-emotion-recognition Speech Emotion Recognition using Deep Learning. In this repo, we are...	13	Experimental	2	Jupyter Notebook
49	sh4shv4t/Audio-emotion-detection-using-SNNs End-to-end PyTorch implementation of a Siamese Neural Network (SNN) that...	13	Experimental	—	Jupyter Notebook
50	iam-Hemanth/Speech-Emotion-Recognition Machine learning and Deep Learning project that detects human emotions from...	13	Experimental	—	Jupyter Notebook
51	Baxayesh/music-emotion-recognition A hybrid CNN-RNN model trained on the DEAM dataset for music emotion...	12	Experimental	3	Jupyter Notebook
52	kr1shnasomani/ToneSense Speech emotion recognition from audio clips using CNN	12	Experimental	2	Jupyter Notebook
53	Sukanyasingh3/Speech-Emotion-Recognition Speech Emotion Recognition (SER) using model with LSTM layers, utilizing NLP...	12	Experimental	5	Jupyter Notebook
54	olumideodetunde/Emotion-Recognition This project uses physiological signals from participants and a self report...	12	Experimental	5	Jupyter Notebook
55	AlinaBaber/Speech-Emotions-Recognition-by-feature-extraction-and-Deep-learning-MatLab This repository presents a comprehensive thesis project on Speech Emotion...	11	Experimental	3	MATLAB
56	shan4usmani/Emotion_Analyzer This Project is used to detect emotions using python and Deep learning. It...	11	Experimental	—	Jupyter Notebook
57	DevG06/Speech-Sentiment-Analysis A Deep Learning project to analyse audio files and identify the emotions of...	11	Experimental	—	Jupyter Notebook
58	LucT3/Emotion-Classification-and-Affective-State-Measure-Artificial-Neural-Networks Intelligent Systems course project (MSc in Computer Engineering @ Unversity...	11	Experimental	—	MATLAB
59	MIntelligence-Group/SpeechImg_EmoRec Published in Springer Multimedia Tools and Applications Journal.	11	Experimental	3	—
60	siddhantpathakk/EmotionNet Using GRUs to model emotions in utterances using context-awareness...	11	Experimental	4	Jupyter Notebook
61	makhta43/Speech-Emotion-Recognition Speech Emotion Recognition project made in python with machine learning	10	Experimental	2	Jupyter Notebook
62	EesunMoon/On-device_Multimodal_ER [Research - MINES Lab] Multimodal Emotion Recognition for On-device AI	10	Experimental	2	Python

Comparisons in this category

Speech-Emotion-Analyzer and emotion-recognition-using-speech (51 vs 51) Speech-Emotion-Analyzer and emotion-classification-from-audio-files (51 vs 51) Speech-Emotion-Analyzer and speech-emotion-recognition (51 vs 47) Speech-Emotion-Analyzer and speech-emotion-recognition (51 vs 43) Multimodal-Emotion-Recognition and MULTIMODAL-EMOTION-RECOGNITION (51 vs 45) emotion-recognition-using-speech and speech-emotion-recognition (51 vs 47) emotion-recognition-using-speech and speech-emotion-recognition (51 vs 43) emotion-recognition-using-speech and Speech-Emotion-Recognition (51 vs 32) SpeechEmotionRecognition_Realtime and Speech-Emotion-Recognition (38 vs 32)