haoheliu/AudioLDM-training-finetuning
AudioLDM training, finetuning, evaluation and inference.
Builds on latent diffusion architecture with integrated AudioMAE and CLAP encoders for text-to-audio generation, leveraging VAE compression and HiFiGAN vocoding at multiple sample rates. Supports custom dataset training without preprocessing via automatic resampling and segmentation, with built-in evaluation metrics for generated audio quality assessment. Compatible with both medium and small model variants, enabling efficient finetuning from pretrained checkpoints on AudioCaps or user-defined datasets.
297 stars. No commits in the last 6 months.
Stars
297
Forks
58
Language
Python
License
MIT
Category
Last pushed
Dec 13, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/haoheliu/AudioLDM-training-finetuning"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PrunaAI/pruna
Pruna is a model optimization framework built for developers, enabling you to deliver faster,...
bytedance/LatentSync
Taming Stable Diffusion for Lip Sync!
Text-to-Audio/Make-An-Audio
PyTorch Implementation of Make-An-Audio (ICML'23) with a Text-to-Audio Generative Model
Aratako/Irodori-TTS
A Flow Matching-based Text-to-Speech Model with Emoji-driven Style Control
sayakpaul/diffusers-torchao
End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8...