Image Captioning NLP Tools

Tools for generating natural language descriptions from images using computer vision and NLP techniques. Does NOT include text-to-image generation, scene graph parsing, or reverse image retrieval.

There are 47 image captioning tools tracked. The highest-rated is ntrang086/image_captioning at 39/100 with 81 stars.

Get all 47 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=image-captioning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	ntrang086/image_captioning generate captions for images using a CNN-RNN model that is trained on the...	39	Emerging	81	Python
2	fregu856/CS224n_project Neural Image Captioning in TensorFlow.	37	Emerging	65	Jupyter Notebook
3	vacancy/SceneGraphParser A python toolkit for parsing captions (in natural language) into scene...	36	Emerging	592	Python
4	ltguo19/VSUA-Captioning Code for "Aligning Linguistic Words and Visual Semantic Units for Image...	34	Emerging	258	Python
5	Abdelrhman-Yasser/video-content-description Video content description model for generating descriptions for unconstrained videos	32	Emerging	15	Jupyter Notebook
6	kozodoi/BMS_Molecular_Translation Image-to-text translation of chemical molecule structures with deep learning...	31	Emerging	14	Jupyter Notebook
7	nithintata/image-caption-generator-using-deep-learning Automatically generates captions for an image using Image processing and...	31	Emerging	11	Jupyter Notebook
8	shan18/Perceiver-Resampler-XAttn-Captioning Generating Captions via Perceiver-Resampler Cross-Attention Networks	30	Emerging	17	Python
9	tranquoctrinh/Image-Captioning-EfficientNet-Transformer Image Captioning with Encoder as Efficientnet and Decoder as Decoder of...	29	Experimental	7	Python
10	Projects-at-UWM/Image-Caption-Generation This project has the capability of generating image description and then...	25	Experimental	4	Jupyter Notebook
11	CISiPLab/cisip-CoCa Compact Image Captioning (CoCA) is an open source image captioning project...	25	Experimental	3	Python
12	aviralchharia/Neural-Image-Captioning In this project, we use a Deep Recurrent Architecture, which uses CNN...	24	Experimental	3	Jupyter Notebook
13	matakshay/Neural_Image_Caption_Generator Deep Learning model which uses Computer Vision and NLP to generate captions...	24	Experimental	15	Jupyter Notebook
14	nicolafan/image-captioning-cnn-rnn Tensorflow/Keras implementation of an image captioning neural network, using...	23	Experimental	6	Python
15	seloufian/Scenes-Interpreter-Tool Classification and textual description generation of object-based images.	23	Experimental	2	Python
16	itzTerra/vis-desc Research lab and experimental app for visual descriptiveness/imageability scoring	22	Experimental	—	Jupyter Notebook
17	heng-hw/SpaCap3D [IJCAI 2022] Spatiality-guided Transformer for 3D Dense Captioning on Point...	22	Experimental	21	Python
18	soheil-mp/Automatic-Image-Captioning Automatically captioning a unseen image using encoding with CNN and decoding...	21	Experimental	9	Jupyter Notebook
19	us-utkarshsri07/VisionSpeak Attention based image captioning system using CNN encoder and LSTM decoder...	20	Experimental	1	Jupyter Notebook
20	HagAli22/Image-Captain Image captioning with custom Transformer decoder comparing ResNet-50 (CNN)...	19	Experimental	—	Python
21	Thejesh-M/Image-Captioning Image Captioning is the process of generating textual description of an...	19	Experimental	8	Jupyter Notebook
22	shhdSU/Image_Captioning_DeepLearning This project aims to generate a textual description for images through...	19	Experimental	4	Jupyter Notebook
23	Pzhvk/Captioneer An in-depth comparison of three image captioning models built with PyTorch....	16	Experimental	1	Jupyter Notebook
24	akarsh-saxena/Image-Caption-Generator A deep learning based image caption generator.	16	Experimental	2	Jupyter Notebook
25	deepak2233/Image-Captioning-Bot Image Captioning: Implementing the Image Caption Generator with python	16	Experimental	3	Jupyter Notebook
26	janerjzou/image_caption_multi-label_classification Apply EfficientNet-B4 and Bi-LSTM to classify images based on image...	16	Experimental	4	Jupyter Notebook
27	dionisiuspr/image-captioning ViT-GPT2 Image Captioning	16	Experimental	2	Jupyter Notebook
28	ChaitanyaGhadling/AttentionGAN Converts the text description of birds into images. 🐦Let your imagination fly. 🦜	15	Experimental	2	Jupyter Notebook
29	ZainAlabidinShbani/image-captioning-ai Image Captioning AI is a deep learning project that generates natural...	15	Experimental	1	Jupyter Notebook
30	raj-tyagi/4CLIP-Image-Captioning This repository presents 4CLIP, a novel approach to image captioning that...	14	Experimental	—	Python
31	VivienPatrick/image-captioning-deep-learning Image captioning model using pretrained EfficientNet and LSTM with TensorFlow	14	Experimental	—	Jupyter Notebook
32	doubledaibo/compcaption_neurips2018 A Neural Compositional Paradigm for Image Captioning	14	Experimental	9	Lua
33	Avaneesh40585/Flickr8k-Dataset A repository hosting the complete Flickr8k dataset, prepared and ready for...	14	Experimental	4	—
34	basic-go-ahead/wikipedia-image-caption-matching The 3rd place solution code for the Wikipedia - Image/Caption Matching...	14	Experimental	1	Jupyter Notebook
35	SudharshanShanmugasundaram/Neural-Image-Caption-Generation Implementation of Neural Image Caption Generation using Flicker dataset.It...	12	Experimental	3	Jupyter Notebook
36	MJAHMADEE/Image_Captioning Image Captioning	12	Experimental	3	Jupyter Notebook
37	harshitrajora/Video-Captioning This project is an End-to-End Video Captioning System designed to bridge the...	12	Experimental	1	Python
38	5anjana/humorous-caption-generation Generate data science meme captions from images using a multimodal model...	12	Experimental	1	Jupyter Notebook
39	tgieruc/Heritage-in-the-digital-age A Step-by-Step Guide to Augmenting Digitized Historical Images, Semester...	12	Experimental	3	Jupyter Notebook
40	NDDimension/Image-Caption-Generator-using-CNN-LSTM A Deep-Learning based web app that generates image captions using a...	12	Experimental	1	Jupyter Notebook
41	jatin-42/Image-captioning-gcn-rnn Generates natural language captions for images using Graph Convolutional...	11	Experimental	—	Jupyter Notebook
42	abhishukla0204/Image-Caption-Generator Generate image captions using Deep Learning (CNN + LSTM). Includes Streamlit...	11	Experimental	—	Jupyter Notebook
43	Bifrost-Mesh/post-caption-labelling-microservice Post caption Labelling Microservice	11	Experimental	—	Python
44	dinhanhx/rct r/cosplay title crawler	11	Experimental	2	Python
45	umitsarioz/ChestX-AI It's a machine learning project for image captioning on radiological Chest...	10	Experimental	1	Jupyter Notebook
46	steveive8/GAN-Cognitive Generating the human cognitive with the human perspective data, including...	10	Experimental	1	—
47	xmassmx/Image-Captioning Image Captioning using encoder-decoder and attention	10	Experimental	1	Python