Multimodal Rag Systems Transformer Models

There are 3 multimodal rag systems models tracked. 1 score above 50 (established tier). The highest-rated is lightonai/pylate at 64/100 with 742 stars. 1 of the top 10 are actively maintained.

Get all 3 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=multimodal-rag-systems&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Model Score Tier
1 lightonai/pylate

Late Interaction Models Training & Retrieval

64
Established
2 TIGER-AI-Lab/VLM2Vec

This repo contains the code for "VLM2Vec: Training Vision-Language Models...

48
Emerging
3 Jorffy/NoteMR

[CVPR 2025] Code for "Notes-guided MLLM Reasoning: Enhancing MLLM with...

17
Experimental