Audio Music Learning ML Frameworks

Interactive AI tools and frameworks for learning music performance, instrument technique, and audio analysis through real-time feedback, visualization, and synthesis. Does NOT include general music generation, composition, or production tools.

There are 79 audio music learning frameworks tracked. 2 score above 70 (verified tier). The highest-rated is libAudioFlux/audioFlux at 73/100 with 3,281 stars and 2,051 monthly downloads. 1 of the top 10 are actively maintained.

Get all 79 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=audio-music-learning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	libAudioFlux/audioFlux A library for audio and music analysis, feature extraction.	73	Verified	3,281	C
2	tyiannak/pyAudioAnalysis Python Audio Analysis Library: Feature Extraction, Classification,...	71	Verified	6,235	Python
3	CPJKU/madmom Python audio and music signal processing library	67	Established	1,595	Python
4	MTG/mtg-jamendo-dataset Metadata, scripts and baselines for the MTG-Jamendo dataset	57	Established	371	Python
5	spotify/pedalboard 🎛 🔊 A Python library for audio.	54	Established	6,004	C++
6	dodiku/AudioOwl Fast and simple music and audio analysis using RNN in Python 🕵️‍♀️ 🥁	53	Established	298	Python
7	spotify/basic-pitch A lightweight yet powerful audio-to-MIDI converter with pitch bend detection	51	Established	4,764	Python
8	ybayle/awesome-deep-learning-music List of articles related to deep learning applied to music	47	Emerging	2,956	TeX
9	keums/melodyExtraction_JDC "Joint Detection and Classification of Singing Voice Melody Using...	46	Emerging	131	Jupyter Notebook
10	GuitarML/GuitarLSTM Deep learning models for guitar amp/pedal emulation using LSTM with Keras.	44	Emerging	416	Python
11	sony/FxNorm-automix FxNorm-Automix - Implementation of automatic music mixing systems. We show...	43	Emerging	134	Python
12	jatinchowdhury18/KlonCentaur Digital emulation of the Klon Centaur guitar pedal using RNNs, Wave Digital...	40	Emerging	363	C++
13	salu133445/arranger Official Implementation of "Towards Automatic Instrumentation by Learning to...	38	Emerging	59	Python
14	GuitarML/TS-M1N3 TS-9 guitar pedal clone using neural networks.	38	Emerging	60	C++
15	GuitarML/Proteus Guitar amp and pedal capture plugin using neural networks.	38	Emerging	186	C++
16	GuitarML/NeuralSeed Neural networks for guitar amp/pedal emulation on Daisy Seed	37	Emerging	124	C++
17	felipetovarhenao/bellplay An open-source framework and software for offline algorithmic audio in bell	37	Emerging	4	Max
18	csteinmetz1/automix-toolkit Models and datasets for training deep learning automatic mixing models	36	Emerging	109	Python
19	Guitariz/Guitariz Full-stack music learning web app featuring interactive guitar/piano tools...	35	Emerging	5	TypeScript
20	rsxdalv/musicgen-prompts Site for sharing MusicGen + AudioGen Prompts and Creations	34	Emerging	50	TypeScript
21	GuitarML/Seed Digital Multi-Effect Pedal with Reverb, Delay, Tremolo, Looper, and Neural...	34	Emerging	89	C++
22	opus-arc/Bibo_No-Aozora A memory- and algorithm-driven ear-training software (still under active...	33	Emerging	2	C++
23	dennisvdang/chorus-detection A deep learning project for automated chorus detection in songs, featuring a...	31	Emerging	47	Jupyter Notebook
24	dl4am/tutorial Deep learning for automatic mixing	29	Experimental	30	Jupyter Notebook
25	Novecento99/Holophonor Converts signals to images in real time using AI models	29	Experimental	43	Jupyter Notebook
26	GuitarML/PrincePedal Prince of Tone style guitar plugin made with neural networks	29	Experimental	37	C++
27	anatrini/WavePilot Tool for Reducing and Visualizing Digital Instrument Presets in an...	28	Experimental	2	Max
28	TuneNN/TuneNN A transformer-based network model for pitch detection	28	Experimental	166	JavaScript
29	Duda9922/music-from-drawings-pro 🎵 Transform drawings into music using AI. Create unique soundscapes with our...	28	Experimental	2	Python
30	tabarkarajab/Large-Scale-Audio-dataset This repository basically represent the audio dataset for emergency vehicle...	27	Experimental	8	Jupyter Notebook
31	dariosanfilippo/edgeofchaos This repository is not maintained anymore. If I have any significant...	27	Experimental	57	—
32	trimplexx/music-transcription Deep learning system for automatic guitar tablature transcription using CRNN...	26	Experimental	3	TeX
33	jawebada/piper-audio-example-streaming-web-worker Simple piper-js example	26	Experimental	5	JavaScript
34	CH-RAFAY/SoundTab-AudioProcessing-FYP A specialized system that converts raw guitar audio into accurate musical...	26	Experimental	5	TypeScript
35	KinWaiCheuk/ReconVAT ReconVAT: a semi-supervised automatic music transcription (AMT) model	26	Experimental	40	Python
36	salu133445/deepperformer Deep Performer: Score-to-audio music performance synthesis	26	Experimental	44	SCSS
37	NeptuneHub/AudioMuse-AI-DCLAP AudioMuse-AI-DCLAP is a lightweight, high-speed distilled version of LAION...	25	Experimental	4	Python
38	pxaris/ccml PyTorch implementation of cross-cultural music transfer learning	25	Experimental	13	Python
39	villium/echo Comprehensive audio feature extraction library for signal analysis,...	25	Experimental	1	TypeScript
40	laqieer/piano-scribe Piano transcription with magenta.js	24	Experimental	3	JavaScript
41	ExpertVagabond/ai-music-studio Local AI music production CLI — generate instrumentals (MusicGen), separate...	24	Experimental	—	Python
42	domenicostefani/elk-audio-AI-tutorial Guide to deploying neural networks in VST plugins, with a specific focus on...	23	Experimental	6	Jupyter Notebook
43	WillYKY920/vocal-pitch-monitor This project is dedicated to develop a web-based platform for real-time...	23	Experimental	1	Java
44	qaryEz/YT-Immersion 🎶 Enjoy YouTube music videos with stylish lyrics, auto-updates, and seamless...	22	Experimental	—	JavaScript
45	dhivyasreedhar/Music-Instrument-Recognition A Convolutional Neural Network and a K nearest neighbour based classifier to...	22	Experimental	9	Jupyter Notebook
46	eozd/libreguitar Guitar fretboard teacher app that recognizes notes played on a guitar...	22	Experimental	9	Rust
47	zkazuya/MiMo-Audio-Eval 🔊 Evaluate audio performance with the MiMo-Audio-Eval toolkit, designed for...	22	Experimental	—	Python
48	ashishrobins-hub/AI-audio-analyzer Open-source AI tool for analyzing audio files. Extract tempo, musical key,...	22	Experimental	—	Python
49	Severynson/chord-detector Application detecting guitar Chords in real time powered by Deep Learning.	21	Experimental	2	Jupyter Notebook
50	stefan-baumann/inceptionkeynet A CNN model for key estimation in music recordings	20	Experimental	19	Python
51	anuvgupta/audiU AI-generated music suggestions with Keras	19	Experimental	5	Jupyter Notebook
52	kymatio/ismir23-tutorial Kymatio: Deep Learning meets Wavelet Theory for Music Signal Processing	18	Experimental	14	TeX
53	sh-lee97/grafx-prune Searching for Music Mixing Graphs: A Pruning Approach	18	Experimental	25	Python
54	kundan-6646/Musica Musica is an online audio splitter. It works with the power of AI which...	16	Experimental	1	EJS
55	gcottom/echo-daemon echo-daemon is a self-hosted, dockerized pipeline and chrome extension combo...	16	Experimental	1	Go
56	gkotti4/guitar-audio-transcriber-ai Guitar Audio Transcriber is a deep-learning research project aimed at...	16	Experimental	11	Python
57	pnlong/determine_key Determine the musical key of a given audio sample.	16	Experimental	17	Python
58	anime-song/Chord-Transcription Repository for training chord transcription models. Achieves high-precision...	15	Experimental	5	Python
59	yyf/ai-audio-tools Community list of AI tools , models, and datasets for audio, music, and...	15	Experimental	6	—
60	smimram/learning-effect Modeling guitar amplifiers using machine learning.	14	Experimental	11	OCaml
61	Man0id/AudioViz 🎵 Visualize your music in real-time with AudioViz, featuring unique...	14	Experimental	—	—
62	Komorebirumu/awe-ms-20260316-1206-02 AI Niche Instrument Trainer: Practice & Real-time Feedback	14	Experimental	—	HTML
63	eter5nityforce-oss/harmonic-canvas-music-visualizer 조화로운 캔버스: AI 기반 실시간 음악 시각화	14	Experimental	—	—
64	naufalya/Diapasonix 🎶 Create music effortlessly with Diapasonix, a portable MIDI controller and...	14	Experimental	—	C
65	EyadAbdelaziz1/latent-musicvis 🎶 Explore audio latent spaces in 3D with interactive visualizations; encode,...	14	Experimental	—	HTML
66	pereiraa10/musical-surprisal Exploring the python implementation of IDyOM by Guilhem Marion to be used in...	14	Experimental	—	Jupyter Notebook
67	abletoburntheweb/RhythmFallServer Local Flask backend for audio analysis and automatic chart generation	14	Experimental	—	Python
68	grvnsh/ai-ektara-isolation-model This Python script implements a neural network model for detecting the...	14	Experimental	—	Python
69	Calarts-Creative-Computing/Seraph Seraph is an open platform for developing Teensy-based MIDI controllers and...	14	Experimental	3	C++
70	n1ckfg/LightningLoops A networked musical instrument you play by drawing in 3D space, trained on...	13	Experimental	6	JavaScript
71	sideeffectdk/RT-MIR-OSC Audio input -> real-time analysis -> OSC output. Takes in real-time audio,...	13	Experimental	8	—
72	kauzarc/qualia Real-time audio-reactive visual engine for VJing with online learning	12	Experimental	1	Rust
73	denisakkavim/sample-detection A python library to detect whether one song contains a sample of another.	12	Experimental	4	HTML
74	alexjameswilliams/EDMAudioRepresentations Visualisation and analysis of audio content in EDM DJ mixes	12	Experimental	3	Jupyter Notebook
75	WouterBesse/Sonified-Latent-Data Experiments to sonify different latent distributions generated by encoders...	12	Experimental	3	Jupyter Notebook
76	IGS1I/AI-Audio-Analysis Audio analysis project for AI4ALL Ignite Program (Fall 2024)	11	Experimental	—	Python
77	ninuxi/audio-ai-projects Audio AI Projects - From Sound Design to Machine Learning. Demo Version \|...	11	Experimental	—	Python
78	Yuan-ManX/ai-audio-processing-methods ai audio processing methods	11	Experimental	2	Python
79	bernhardbrugger/soundscapepainter AI-powered tool that transforms paintings into soundscapes using computer...	11	Experimental	—	TypeScript

Comparisons in this category

audioFlux and pyAudioAnalysis (73 vs 71)