Image Captioning NLP Tools

Tools for generating natural language descriptions from images using computer vision and NLP techniques. Does NOT include text-to-image generation, scene graph parsing, or reverse image retrieval.

There are 57 image captioning tools tracked. The highest-rated is ntrang086/image_captioning at 46/100 with 81 stars.

Get all 57 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=image-captioning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	ntrang086/image_captioning generate captions for images using a CNN-RNN model that is trained on the...	46	Emerging	81	Python
2	fregu856/CS224n_project Neural Image Captioning in TensorFlow.	44	Emerging	65	Jupyter Notebook
3	vacancy/SceneGraphParser A python toolkit for parsing captions (in natural language) into scene...	43	Emerging	592	Python
4	ltguo19/VSUA-Captioning Code for "Aligning Linguistic Words and Visual Semantic Units for Image...	41	Emerging	258	Python
5	Abdelrhman-Yasser/video-content-description Video content description model for generating descriptions for unconstrained videos	39	Emerging	15	Jupyter Notebook
6	kozodoi/BMS_Molecular_Translation Image-to-text translation of chemical molecule structures with deep learning...	38	Emerging	14	Jupyter Notebook
7	nithintata/image-caption-generator-using-deep-learning Automatically generates captions for an image using Image processing and...	38	Emerging	11	Jupyter Notebook
8	shan18/Perceiver-Resampler-XAttn-Captioning Generating Captions via Perceiver-Resampler Cross-Attention Networks	37	Emerging	17	Python
9	tranquoctrinh/Image-Captioning-EfficientNet-Transformer Image Captioning with Encoder as Efficientnet and Decoder as Decoder of...	34	Emerging	7	Python
10	CISiPLab/cisip-CoCa Compact Image Captioning (CoCA) is an open source image captioning project...	32	Emerging	3	Python
11	Projects-at-UWM/Image-Caption-Generation This project has the capability of generating image description and then...	32	Emerging	4	Jupyter Notebook
12	aviralchharia/Neural-Image-Captioning In this project, we use a Deep Recurrent Architecture, which uses CNN...	31	Emerging	3	Jupyter Notebook
13	matakshay/Neural_Image_Caption_Generator Deep Learning model which uses Computer Vision and NLP to generate captions...	31	Emerging	15	Jupyter Notebook
14	seloufian/Scenes-Interpreter-Tool Classification and textual description generation of object-based images.	30	Emerging	2	Python
15	nicolafan/image-captioning-cnn-rnn Tensorflow/Keras implementation of an image captioning neural network, using...	30	Emerging	6	Python
16	heng-hw/SpaCap3D [IJCAI 2022] Spatiality-guided Transformer for 3D Dense Captioning on Point...	29	Experimental	21	Python
17	soheil-mp/Automatic-Image-Captioning Automatically captioning a unseen image using encoding with CNN and decoding...	28	Experimental	9	Jupyter Notebook
18	shhdSU/Image_Captioning_DeepLearning This project aims to generate a textual description for images through...	26	Experimental	4	Jupyter Notebook
19	Thejesh-M/Image-Captioning Image Captioning is the process of generating textual description of an...	26	Experimental	8	Jupyter Notebook
20	dionisiuspr/image-captioning ViT-GPT2 Image Captioning	23	Experimental	2	Jupyter Notebook
21	deepak2233/Image-Captioning-Bot Image Captioning: Implementing the Image Caption Generator with python	23	Experimental	3	Jupyter Notebook
22	janerjzou/image_caption_multi-label_classification Apply EfficientNet-B4 and Bi-LSTM to classify images based on image...	23	Experimental	4	Jupyter Notebook
23	itzTerra/vis-desc Research lab and experimental app for visual descriptiveness/imageability scoring	22	Experimental	—	Jupyter Notebook
24	ChaitanyaGhadling/AttentionGAN Converts the text description of birds into images. 🐦Let your imagination fly. 🦜	22	Experimental	2	Jupyter Notebook
25	Pzhvk/Captioneer An in-depth comparison of three image captioning models built with PyTorch....	22	Experimental	1	Jupyter Notebook
26	basic-go-ahead/wikipedia-image-caption-matching The 3rd place solution code for the Wikipedia - Image/Caption Matching...	21	Experimental	1	Jupyter Notebook
27	doubledaibo/compcaption_neurips2018 A Neural Compositional Paradigm for Image Captioning	21	Experimental	9	Lua
28	Avaneesh40585/Flickr8k-Dataset A repository hosting the complete Flickr8k dataset, prepared and ready for...	20	Experimental	4	—
29	MJAHMADEE/Image_Captioning Image Captioning	19	Experimental	3	Jupyter Notebook
30	5anjana/humorous-caption-generation Generate data science meme captions from images using a multimodal model...	19	Experimental	1	Jupyter Notebook
31	SudharshanShanmugasundaram/Neural-Image-Caption-Generation Implementation of Neural Image Caption Generation using Flicker dataset.It...	19	Experimental	3	Jupyter Notebook
32	tgieruc/Heritage-in-the-digital-age A Step-by-Step Guide to Augmenting Digitized Historical Images, Semester...	19	Experimental	3	Jupyter Notebook
33	HagAli22/Image-Captain Image captioning with custom Transformer decoder comparing ResNet-50 (CNN)...	19	Experimental	—	Python
34	umitsarioz/ChestX-AI It's a machine learning project for image captioning on radiological Chest...	17	Experimental	1	Jupyter Notebook
35	steveive8/GAN-Cognitive Generating the human cognitive with the human perspective data, including...	17	Experimental	1	—
36	xmassmx/Image-Captioning Image Captioning using encoder-decoder and attention	17	Experimental	1	Python
37	Koldim2001/Image_captioning Генерация описаний к изображениям с помощью различных архитектур нейронных сетей	14	Experimental	18	Jupyter Notebook
38	harshitrajora/Video-Captioning This project is an End-to-End Video Captioning System designed to bridge the...	14	Experimental	1	Python
39	Rumeysakeskin/Image-Caption-Generation InceptionV3-Multi-layer GRU based automatic image captioning with Keras and...	14	Experimental	20	Jupyter Notebook
40	miguelscarv/pheye Pheye - a family of efficient small vision-language models	12	Experimental	2	Python
41	Rumeysakeskin/Image-Captioning Image captioning with a benchmark of CNN-based encoder and GRU-based...	12	Experimental	8	Python
42	congphase/img-captioning-in-vietnamese An attempt to solve image captioning (in Vietnamese language) regarding ball...	12	Experimental	5	Python
43	VivienPatrick/image-captioning-deep-learning Image captioning model using pretrained EfficientNet and LSTM with TensorFlow	11	Experimental	—	Jupyter Notebook
44	El-Zag/Multimodal-Video-Captioning Master Thesis on Multimodal Video Captioning, done at Huawei's Research...	11	Experimental	3	Python
45	MahmoudIbrahims/Assistant_Generate_text_from_images Generate text from images and translation text English to Arabic	11	Experimental	1	Python
46	jatin-42/Image-captioning-gcn-rnn Generates natural language captions for images using Graph Convolutional...	11	Experimental	—	Jupyter Notebook
47	Manalelaidouni/Caption-Web-App Image caption generation model with customizable end-to-end training...	11	Experimental	4	Python
48	stereopickle/art_title_generator Natural language generator using CNN-LSTM	11	Experimental	4	Jupyter Notebook
49	sanandita001/Image-captioning Image Captioning Resnet 50 and LSTM and Flickr8k	11	Experimental	3	Jupyter Notebook
50	TomatoFT/Image-Captioning Image Captioning with EffiecentNet and Transformer	11	Experimental	3	Python
51	Bifrost-Mesh/post-caption-labelling-microservice Post caption Labelling Microservice	11	Experimental	—	Python
52	ahmed-hassan97/Image_Captioning Image_Captioning using coco dataset and pretrained model	10	Experimental	2	Jupyter Notebook
53	Siddharth1698/Image-Captioning-with-Inception-LSTM An image captioning model that uses flickr8k dataset with Deep learning and...	10	Experimental	2	Jupyter Notebook
54	VishalShah1999/Image_Captioning_Keras_LSTM Image captioning model that captions the given image using CNN and LSTM	10	Experimental	2	Jupyter Notebook
55	MilanaShhanukova/image_captioning This is a repository for the final in Deep Learning Course	10	Experimental	2	Jupyter Notebook
56	mxagar/image_captioning Image captioning project with a deep learning model. Given an image, it is...	10	Experimental	2	Jupyter Notebook
57	hackclubnmit/tensorflow-hacktoberfest-2020 This repo consists of two models in tensorflow 2.3.0. One of movie review...	10	Experimental	2	Jupyter Notebook

Comparisons in this category

Neural_Image_Caption_Generator and Image-Captioning (31 vs 26) Image-Caption-Generation and Neural_Image_Caption_Generator (32 vs 31) Neural_Image_Caption_Generator and Image_Captioning_DeepLearning (31 vs 26) Neural_Image_Caption_Generator and Neural-Image-Captioning (31 vs 31) Neural_Image_Caption_Generator and Image-Captioning-Bot (31 vs 23) Image-Caption-Generation and Image-Captioning (32 vs 26) image-captioning-cnn-rnn and Image-Captioning-Bot (30 vs 23) Image-Caption-Generation and Image_Captioning_DeepLearning (32 vs 26) Image-Caption-Generation and Image-Captioning-Bot (32 vs 23)