umbertocappellazzo/Llama-AVSR

Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners" [ICASSP 2025] and "Mitigating Attention Sinks and Massive Activations in Audio-Visual Speech Recognition with LLMs" [ICASSP 2026].

35
/ 100
Emerging
No License No Package No Dependents
Maintenance 10 / 25
Adoption 8 / 25
Maturity 8 / 25
Community 9 / 25

How are scores calculated?

Stars

57

Forks

5

Language

Python

License

—

Category

multimodal-vision-language

Last pushed

Jan 18, 2026

Commits (30d)

0

GitHub
Multimodal Vision Language · 89 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/umbertocappellazzo/Llama-AVSR"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

om-ai-lab/VLM-R1

Solve Visual Understanding with Reinforced VLMs

60

KimMeen/Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming...

56

bytedance/SALMONN

SALMONN family: A suite of advanced multi-modal LLMs

54

fixie-ai/ultravox

A fast multimodal LLM for real-time voice

51

NVlabs/OmniVinci

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

51

Explore Transformer Models

All categories Trending Transformer directory Insights