SkalskiP/awesome-foundation-and-multimodal-models
👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]
This is a curated list of advanced artificial intelligence models that can understand and process different types of information, like images, text, and audio, simultaneously. It provides a directory of recent research papers, code, and examples for various foundation and multimodal models. Anyone interested in exploring or applying cutting-edge AI for tasks involving diverse data types, such as visual question answering or object detection, would find this useful.
638 stars. No commits in the last 6 months.
Use this if you need to find state-of-the-art AI models that can interpret and combine information from sources like images, text, or audio for a variety of tasks.
Not ideal if you are looking for ready-to-use, deployable applications rather than a collection of research models and their resources.
Stars
638
Forks
45
Language
Python
License
—
Category
Last pushed
Feb 29, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/SkalskiP/awesome-foundation-and-multimodal-models"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
gabeur/mmt
Multi-Modal Transformer for Video Retrieval
JerryYLi/valhalla-nmt
Code repository for CVPR 2022 paper "VALHALLA: Visual Hallucination for Machine Translation"
MichiganNLP/Scalable-VLM-Probing
Probe Vision-Language Models
benywon/LALM
code and resource for ACL2021 paper 'Multi-Lingual Question Generation with Language Agnostic...
thunlp/cost-optimal-gqa
The code for the paper "Cost-Optimal Grouped-Query Attention for Long-Context Modeling"