AmphionTeam/FlexiCodec
[ICLR2026] FlexiCodec: A Dynamic Neural Audio Codec for Low Frame Rates
Implements dynamic frame rate encoding that adaptively merges semantically similar frames (3–12.5Hz) using ASR-assisted dual-stream encoding and Transformer bottlenecks to preserve semantic information at very low frame rates. Decouples semantic and acoustic codes for efficient speech language model integration, with inference-time controllable compression via `merging_threshold`. Includes AR+NAR TTS pipeline and Voicebox NAR decoder for speech synthesis from FlexiCodec tokens.
Stars
42
Forks
4
Language
Python
License
MIT
Category
Last pushed
Mar 10, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/voice-ai/AmphionTeam/FlexiCodec"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
shangeth/wavencoder
WavEncoder is a Python library for encoding audio signals, transforms for audio augmentation,...
fatchord/WaveRNN
WaveRNN Vocoder + TTS
kan-bayashi/ParallelWaveGAN
Unofficial Parallel WaveGAN (+ MelGAN & Multi-band MelGAN & HiFi-GAN & StyleMelGAN) with Pytorch
seungwonpark/melgan
MelGAN vocoder (compatible with NVIDIA/tacotron2)
rishikksh20/iSTFTNet-pytorch
iSTFTNet : Fast and Lightweight Mel-spectrogram Vocoder Incorporating Inverse Short-time Fourier...