Advocate99/DiffGesture

Employs a Diffusion Audio-Gesture Transformer architecture to jointly model cross-modal audio-to-skeleton associations while preserving temporal coherence through an annealed noise sampling strategy. Integrates classifier-free guidance for diversity-quality trade-offs and uses pretrained autoencoders (from HA2G) for perceptual metrics on TED Gesture and TED Expressive datasets. Supports both short/long video synthesis with skeleton sequence generation conditioned on audio input.

261 stars.