inclusionAI/Ming-UniAudio
Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation
**Summary for Developer Directory:** Built on MingTok-Audio, a unified continuous speech tokenizer using VAE with causal Transformer architecture, Ming-UniAudio integrates semantic and acoustic features to enable a single LLM backbone for both speech understanding and generation tasks. It introduces instruction-guided free-form speech editing without timestamp requirements, powered by a Diffusion Head for synthesis quality. Models are available on Hugging Face and ModelScope with ASR/TTS fine-tuning recipes and the first open-source free-form audio editing benchmark.
435 stars.
Stars
435
Forks
28
Language
Python
License
MIT
Category
Last pushed
Nov 27, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/voice-ai/inclusionAI/Ming-UniAudio"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Spr-Aachen/Easy-Voice-Toolkit
A user-friendly audio toolkit for voice recognition, voice transcription, voice conversion etc.
ftyers/commonvoice-utils
Linguistic processing for Common Voice
alphacep/awesome-russian-speech
Russian speech technology links
microsoft/UniSpeech
UniSpeech - Large Scale Self-Supervised Learning for Speech
microsoft/SpeechT5
Unified-Modal Speech-Text Pre-Training for Spoken Language Processing