Multimodal Vision Language Models

There are 18 multimodal vision language models tracked. 1 score above 50 (established tier). The highest-rated is BradyFU/Awesome-Multimodal-Large-Language-Models at 56/100 with 17,448 stars. 2 of the top 10 are actively maintained.

Get all 18 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=multimodal-vision-language-models&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	BradyFU/Awesome-Multimodal-Large-Language-Models :sparkles::sparkles:Latest Advances on Multimodal Large Language Models	56	Established	17,448	—
2	FoundationVision/Liquid (Accepted by IJCV) Liquid: Language Models are Scalable and Unified...	39	Emerging	640	Python
3	Paranioar/Awesome_Matching_Pretraining_Transfering The Paper List of Large Multi-Modality Model (Perception, Generation,...	39	Emerging	445	—
4	Yangyi-Chen/Multimodal-AND-Large-Language-Models Paper list about multimodal and large language models, only used to record...	38	Emerging	756	—
5	thuml/AutoTimes Official implementation for "AutoTimes: Autoregressive Time Series...	37	Emerging	259	Python
6	flixpar/med-ts-llm MedTsLLM: Leveraging LLMs for Multimodal Medical Time Series Analysis	34	Emerging	65	Python
7	Traffic-Alpha/LLM-Assisted-Light This repository contains the code for the paper "LLM-Assisted Light:...	33	Emerging	99	Python
8	urban-mobility-generation/Language-Modeling-for-Urban-Mobility Language Modeling for Urban Mobility: A Data-Centric Review and Guidelines	32	Emerging	9	—
9	Lupin1998/Awesome-MIM [Survey] Masked Modeling for Self-supervised Representation Learning on...	32	Emerging	353	Python
10	HenryHZY/Awesome-Multimodal-LLM Research Trends in LLM-guided Multimodal Learning.	29	Experimental	356	—
11	IrohXu/Awesome-Multimodal-LLM-Autonomous-Driving [WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving	29	Experimental	309	—
12	qingsongedu/Awesome-TimeSeries-SpatioTemporal-LM-LLM A professional list on Large (Language) Models and Foundation Models (LLM,...	29	Experimental	1,203	—
13	uncbiag/Awesome-Foundation-Models A curated list of foundation models for vision and language tasks	28	Experimental	1,149	—
14	liaoyuhua/LLM4TS Large Language & Foundation Models for Time Series.	27	Experimental	560	—
15	Orlando-CS/Awesome-VLA ✨✨latest advancements in VLA models(VIsion Language Action)	27	Experimental	109	—
16	The-Martyr/Awesome-Modality-Priors-in-MLLMs Latest Advances on Modality Priors in Multimodal Large Language Models	20	Experimental	30	—
17	vaew/Awesome-spatial-visual-reasoning-MLLMs Repository for awesome spatial/visual reasoning MLLMs. (focus more on...	16	Experimental	71	Python
18	pipixin321/Awesome-Video-MLLMs :fire: :fire: :fire: Awesome MLLMs/Benchmarks for Short/Long/Streaming Video...	14	Experimental	62	—

Comparisons in this category

Awesome-Multimodal-Large-Language-Models and Awesome-Multimodal-LLM (56 vs 29) Awesome-Multimodal-Large-Language-Models and Awesome-Multimodal-LLM-Autonomous-Driving (56 vs 29) Awesome-Multimodal-Large-Language-Models and Awesome-VLA (56 vs 27)