llm-lab-org/Multimodal-RAG-Survey
A Survey on Multimodal Retrieval-Augmented Generation
Organizes and taxonomizes papers on multimodal RAG systems across retrieval strategies (text/vision/video/audio-centric), fusion mechanisms, augmentation techniques, and generation approaches. Provides comprehensive dataset benchmarks spanning image-text, video, audio, medical, and fashion domains with evaluation metrics and training methodologies. Continuously updated resource tracking advances in cross-modal alignment, agentic interaction, and robustness for systems that ground LLM outputs in multimodal external knowledge bases.
487 stars.
Stars
487
Forks
26
Language
—
License
—
Category
Last pushed
Feb 20, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/llm-lab-org/Multimodal-RAG-Survey"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AnswerDotAI/byaldi
Use late-interaction multi-modal models such as ColPali in just a few lines of code.
illuin-tech/colpali
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
jolibrain/colette
Multimodal RAG to search and interact locally with technical documents of any kind
nannib/nbmultirag
Un framework in Italiano ed Inglese, che permette di chattare con i propri documenti in RAG,...
OpenBMB/VisRAG
Parsing-free RAG supported by VLMs