claws-lab/projection-in-MLLMs

Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'

/ 100

Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 6 / 25

Maturity 1 / 25

Community 5 / 25

Stars

Forks

Language

Python

License

—

Category

Last pushed

Jul 21, 2024

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/claws-lab/projection-in-MLLMs"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

om-ai-lab/VLM-R1

Solve Visual Understanding with Reinforced VLMs

KimMeen/Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming...

bytedance/SALMONN

SALMONN family: A suite of advanced multi-modal LLMs

fixie-ai/ultravox

A fast multimodal LLM for real-time voice

NVlabs/OmniVinci

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.