Audio Music Learning ML Frameworks

Interactive AI tools and frameworks for learning music performance, instrument technique, and audio analysis through real-time feedback, visualization, and synthesis. Does NOT include general music generation, composition, or production tools.

There are 78 audio music learning frameworks tracked. 6 score above 50 (established tier). The highest-rated is tyiannak/pyAudioAnalysis at 62/100 with 6,235 stars.

Get all 78 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=audio-music-learning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	tyiannak/pyAudioAnalysis Python Audio Analysis Library: Feature Extraction, Classification,...	62	Established	6,235	Python
2	libAudioFlux/audioFlux A library for audio and music analysis, feature extraction.	62	Established	3,281	C
3	CPJKU/madmom Python audio and music signal processing library	58	Established	1,595	Python
4	MTG/mtg-jamendo-dataset Metadata, scripts and baselines for the MTG-Jamendo dataset	57	Established	371	Python
5	spotify/pedalboard 🎛 🔊 A Python library for audio.	54	Established	6,004	C++
6	spotify/basic-pitch A lightweight yet powerful audio-to-MIDI converter with pitch bend detection	51	Established	4,764	Python
7	dodiku/AudioOwl Fast and simple music and audio analysis using RNN in Python 🕵️‍♀️ 🥁	48	Emerging	298	Python
8	ybayle/awesome-deep-learning-music List of articles related to deep learning applied to music	47	Emerging	2,956	TeX
9	keums/melodyExtraction_JDC "Joint Detection and Classification of Singing Voice Melody Using...	46	Emerging	131	Jupyter Notebook
10	GuitarML/GuitarLSTM Deep learning models for guitar amp/pedal emulation using LSTM with Keras.	44	Emerging	416	Python
11	sony/FxNorm-automix FxNorm-Automix - Implementation of automatic music mixing systems. We show...	43	Emerging	134	Python
12	felipetovarhenao/bellplay An open-source framework and software for offline algorithmic audio in bell	41	Emerging	4	Max
13	jatinchowdhury18/KlonCentaur Digital emulation of the Klon Centaur guitar pedal using RNNs, Wave Digital...	40	Emerging	363	C++
14	Guitariz/Guitariz Full-stack music learning web app featuring interactive guitar/piano tools...	39	Emerging	5	TypeScript
15	salu133445/arranger Official Implementation of "Towards Automatic Instrumentation by Learning to...	38	Emerging	59	Python
16	GuitarML/TS-M1N3 TS-9 guitar pedal clone using neural networks.	38	Emerging	60	C++
17	GuitarML/Proteus Guitar amp and pedal capture plugin using neural networks.	38	Emerging	186	C++
18	GuitarML/NeuralSeed Neural networks for guitar amp/pedal emulation on Daisy Seed	37	Emerging	124	C++
19	csteinmetz1/automix-toolkit Models and datasets for training deep learning automatic mixing models	36	Emerging	109	Python
20	GuitarML/Seed Digital Multi-Effect Pedal with Reverb, Delay, Tremolo, Looper, and Neural...	34	Emerging	89	C++
21	rsxdalv/musicgen-prompts Site for sharing MusicGen + AudioGen Prompts and Creations	34	Emerging	50	TypeScript
22	tabarkarajab/Large-Scale-Audio-dataset This repository basically represent the audio dataset for emergency vehicle...	34	Emerging	8	Jupyter Notebook
23	Duda9922/music-from-drawings-pro 🎵 Transform drawings into music using AI. Create unique soundscapes with our...	34	Emerging	2	Python
24	trimplexx/music-transcription Deep learning system for automatic guitar tablature transcription using CRNN...	33	Emerging	3	TeX
25	anatrini/WavePilot Tool for Reducing and Visualizing Digital Instrument Presets in an...	32	Emerging	2	Max
26	pxaris/ccml PyTorch implementation of cross-cultural music transfer learning	32	Emerging	13	Python
27	dennisvdang/chorus-detection A deep learning project for automated chorus detection in songs, featuring a...	31	Emerging	47	Jupyter Notebook
28	domenicostefani/elk-audio-AI-tutorial Guide to deploying neural networks in VST plugins, with a specific focus on...	30	Emerging	6	Jupyter Notebook
29	dhivyasreedhar/Music-Instrument-Recognition A Convolutional Neural Network and a K nearest neighbour based classifier to...	29	Experimental	9	Jupyter Notebook
30	dl4am/tutorial Deep learning for automatic mixing	29	Experimental	30	Jupyter Notebook
31	eozd/libreguitar Guitar fretboard teacher app that recognizes notes played on a guitar...	29	Experimental	9	Rust
32	GuitarML/PrincePedal Prince of Tone style guitar plugin made with neural networks	29	Experimental	37	C++
33	Novecento99/Holophonor Converts signals to images in real time using AI models	29	Experimental	43	Jupyter Notebook
34	CH-RAFAY/SoundTab-AudioProcessing-FYP A specialized system that converts raw guitar audio into accurate musical...	28	Experimental	5	TypeScript
35	TuneNN/TuneNN A transformer-based network model for pitch detection	28	Experimental	166	JavaScript
36	stefan-baumann/inceptionkeynet A CNN model for key estimation in music recordings	27	Experimental	19	Python
37	dariosanfilippo/edgeofchaos This repository is not maintained anymore. If I have any significant...	27	Experimental	57	—
38	WillYKY920/vocal-pitch-monitor This project is dedicated to develop a web-based platform for real-time...	27	Experimental	1	Java
39	villium/echo Comprehensive audio feature extraction library for signal analysis,...	27	Experimental	1	TypeScript
40	Severynson/chord-detector Application detecting guitar Chords in real time powered by Deep Learning.	27	Experimental	2	Jupyter Notebook
41	salu133445/deepperformer Deep Performer: Score-to-audio music performance synthesis	26	Experimental	44	SCSS
42	KinWaiCheuk/ReconVAT ReconVAT: a semi-supervised automatic music transcription (AMT) model	26	Experimental	40	Python
43	laqieer/piano-scribe Piano transcription with magenta.js	26	Experimental	3	JavaScript
44	anuvgupta/audiU AI-generated music suggestions with Keras	26	Experimental	5	Jupyter Notebook
45	kymatio/ismir23-tutorial Kymatio: Deep Learning meets Wavelet Theory for Music Signal Processing	25	Experimental	14	TeX
46	sh-lee97/grafx-prune Searching for Music Mixing Graphs: A Pruning Approach	25	Experimental	25	Python
47	ExpertVagabond/ai-music-studio Local AI music production CLI — generate instrumentals (MusicGen), separate...	24	Experimental	—	Python
48	pnlong/determine_key Determine the musical key of a given audio sample.	23	Experimental	17	Python
49	gcottom/echo-daemon echo-daemon is a self-hosted, dockerized pipeline and chrome extension combo...	22	Experimental	1	Go
50	zkazuya/MiMo-Audio-Eval 🔊 Evaluate audio performance with the MiMo-Audio-Eval toolkit, designed for...	22	Experimental	—	Python
51	yyf/ai-audio-tools Community list of AI tools , models, and datasets for audio, music, and...	22	Experimental	6	—
52	ashishrobins-hub/AI-audio-analyzer Open-source AI tool for analyzing audio files. Extract tempo, musical key,...	22	Experimental	—	Python
53	qaryEz/YT-Immersion 🎶 Enjoy YouTube music videos with stylish lyrics, auto-updates, and seamless...	21	Experimental	—	JavaScript
54	smimram/learning-effect Modeling guitar amplifiers using machine learning.	21	Experimental	11	OCaml
55	Calarts-Creative-Computing/Seraph Seraph is an open platform for developing Teensy-based MIDI controllers and...	21	Experimental	3	C++
56	gkotti4/guitar-audio-transcriber-ai Guitar Audio Transcriber is a deep-learning research project aimed at...	20	Experimental	11	Python
57	sideeffectdk/RT-MIR-OSC Audio input -> real-time analysis -> OSC output. Takes in real-time audio,...	20	Experimental	8	—
58	n1ckfg/LightningLoops A networked musical instrument you play by drawing in 3D space, trained on...	20	Experimental	6	JavaScript
59	WouterBesse/Sonified-Latent-Data Experiments to sonify different latent distributions generated by encoders...	19	Experimental	3	Jupyter Notebook
60	denisakkavim/sample-detection A python library to detect whether one song contains a sample of another.	19	Experimental	4	HTML
61	alexjameswilliams/EDMAudioRepresentations Visualisation and analysis of audio content in EDM DJ mixes	19	Experimental	3	Jupyter Notebook
62	Yuan-ManX/ai-audio-processing-methods ai audio processing methods	18	Experimental	2	Python
63	anime-song/Chord-Transcription Repository for training chord transcription models. Achieves high-precision...	17	Experimental	5	Python
64	kauzarc/qualia Real-time audio-reactive visual engine for VJing with online learning	16	Experimental	1	Rust
65	EyadAbdelaziz1/latent-musicvis 🎶 Explore audio latent spaces in 3D with interactive visualizations; encode,...	14	Experimental	—	HTML
66	eter5nityforce-oss/harmonic-canvas-music-visualizer 조화로운 캔버스: AI 기반 실시간 음악 시각화	14	Experimental	—	—
67	naufalya/Diapasonix 🎶 Create music effortlessly with Diapasonix, a portable MIDI controller and...	14	Experimental	—	C
68	abletoburntheweb/RhythmFallServer Local Flask backend for audio analysis and automatic chart generation	14	Experimental	—	Python
69	IGS1I/AI-Audio-Analysis Audio analysis project for AI4ALL Ignite Program (Fall 2024)	13	Experimental	—	Python
70	ninuxi/audio-ai-projects Audio AI Projects - From Sound Design to Machine Learning. Demo Version \|...	13	Experimental	—	Python
71	Man0id/AudioViz 🎵 Visualize your music in real-time with AudioViz, featuring unique...	13	Experimental	—	—
72	grvnsh/ai-ektara-isolation-model This Python script implements a neural network model for detecting the...	13	Experimental	—	Python
73	StarkVision-AI/MoM-CLAM Melody or Machine: Detecting Synthetic Music with Dual- Stream Contrastive Learning	13	Experimental	2	Jupyter Notebook
74	dssudake/AudMIX A web-based system for processing Audio using Deep Learning	12	Experimental	7	JavaScript
75	musevarg/AI-Neural-Network-Classifying-Guitar-Distortions Convolutional neural network to classify audio files (Python, Keras,...	11	Experimental	3	Jupyter Notebook
76	GANs-N-Roses/image AI pipeline to enable people to feel visual art through the sense of hearing	11	Experimental	—	Jupyter Notebook
77	pereiraa10/musical-surprisal Exploring the python implementation of IDyOM by Guilhem Marion to be used in...	11	Experimental	—	Jupyter Notebook
78	Utkarsh-Tyagi-16/Audio-CNN 🎶 Audio CNN Visualizer — A full-stack app to upload WAV files, run CNN-based...	11	Experimental	2	TypeScript

Comparisons in this category

NeuralSeed and Seed (37 vs 34)