ASR Evaluation Metrics Voice AI Tools

Tools for measuring and analyzing the accuracy of automatic speech recognition systems through metrics like WER, CER, and DER. Does NOT include ASR models themselves, transcription services, or general audio quality assessment.

There are 27 asr evaluation metrics tools tracked. 6 score above 50 (established tier). The highest-rated is kahne/fastwer at 62/100 with 70 stars.

Get all 27 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=voice-ai&subcategory=asr-evaluation-metrics&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	kahne/fastwer A PyPI package for fast word/character error rate (WER/CER) calculation	62	Established	70	Python
2	analyticsinmotion/werpy 🐍📦 Ultra-fast Python package for calculating and analyzing the Word Error...	61	Established	23	Python
3	fgnt/meeteval MeetEval - A meeting transcription evaluation toolkit	61	Established	149	Python
4	tabahi/bournemouth-forced-aligner Extract phoneme-level timestamps from speeh audio.	58	Established	121	Python
5	wq2012/SimpleDER A lightweight library to compute Diarization Error Rate (DER).	57	Established	62	Python
6	readbeyond/aeneas aeneas is a Python/C library and a set of tools to automagically synchronize...	55	Established	2,811	Python
7	OpenBMB/UltraEval-Audio Your faithful, impartial partner for audio evaluation — know yourself, know...	49	Emerging	281	Python
8	belambert/asr-evaluation Python module for evaluating ASR hypotheses (e.g. word error rate, word...	49	Emerging	283	Python
9	symblai/speech-recognition-evaluation Evaluate results from ASR/Speech-to-Text quickly	47	Emerging	41	JavaScript
10	analyticsinmotion/werx 🐍📦 Easy-to-use Python package for lightning-fast Word Error Rate (WER) analysis	47	Emerging	8	Python
11	hyeonsangjeon/computing-Korean-STT-error-rates STT 한글 문장 인식기 출력 스크립트의 외자 오류율(CER), 단어 오류율(WER)을 계산하는 Python 함수 패키지	40	Emerging	68	Python
12	tts-hub/monotonic_alignment_search Monotonically align text and speech	37	Emerging	4	Python
13	dangkhoadl/WER-in-cpp Calculates the word error rate between the reference and hypothesis in ASR,...	31	Emerging	2	C++
14	slanglabs-projects/asr-wer-bench Workbench for benchmarking Word Error Rate (WER) of Automatic Speech...	31	Emerging	4	Jupyter Notebook
15	jumon/pywer A simple Python package to calculate word error rate (WER).	31	Emerging	5	Python
16	2017fandrei/ForcedAlignment Graphical utility for forced alignment using aeneas, an interactive audio player	30	Emerging	6	Python
17	codycollier/wer A word error rate util for golang	30	Emerging	2	Go
18	anilkeshwani/speech-text-alignment Functionality for speech data processing including time alignment, encoding...	29	Experimental	4	Python
19	narVidhai/Speech-Transcription-Benchmarking Example python scripts to evaluate various ASR methods	28	Experimental	11	Python
20	enesyugan/PIER-CodeSwitching-Evaluation Point of Interest Error Rate (PIER) Metric for Code-Switching ASR: A...	26	Experimental	5	Python
21	thibault-roux/metric-evaluator Metric evaluator for Automatic Speech Recognition using the HATS dataset	22	Experimental	6	Python
22	MahtaFetrat/Mana-Forced-Aligner A robust forced alignment tool for low-resource languages using multiple ASR...	21	Experimental	6	Jupyter Notebook
23	wq2012/mdeval Python implementation of the NIST md-eval.pl script for evaluating rich...	20	Experimental	1	Python
24	oplatek/moosenet-plda Official repo for “MooseNet: A Trainable Metric for Synthesized Speech with...	20	Experimental	6	Python
25	shahruk10/go-sctk Go CLI wrapper around SCTK binaries for word error rate evaluation and error...	19	Experimental	3	Go
26	ikegami-yukino/csj-eval For evaluating speech recognition system using the Corpus of Spontaneous...	19	Experimental	3	Python
27	mdhasanai/computer-cer Character Error Rate For Automatic Speech Recognition System	10	Experimental	2	—

Comparisons in this category

aeneas and ForcedAlignment (55 vs 30) fastwer and werpy (62 vs 61) fastwer and werx (62 vs 47) fastwer and pywer (62 vs 31) werpy and werx (61 vs 47) werpy and pywer (61 vs 31) werx and pywer (47 vs 31)