buhsnn/Vision-Language-Model

Vision-language model combining a ResNet18 vision encoder with a GPT-2 decoder, fine-tuned for visual instruction tuning and image-conditioned text generation.

15
/ 100
Experimental
No License No Package No Dependents
Maintenance 13 / 25
Adoption 1 / 25
Maturity 1 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Jupyter Notebook

License

—

Category

vision-language-models

Last pushed

Mar 10, 2026

Commits (30d)

0

GitHub
Vision Language Models · 56 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/buhsnn/Vision-Language-Model"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

kyegomez/PALI3

Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"

51

kyegomez/RT-X

Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment:...

51

chuanyangjin/MMToM-QA

[🏆Outstanding Paper Award at ACL 2024] MMToM-QA: Multimodal Theory of Mind Question Answering

47

kyegomez/PALM-E

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

45

lyuchenyang/Macaw-LLM

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

45

Explore Transformer Models

All categories Trending Transformer directory Insights