mlfoundations/open_flamingo
An open-source framework for training large multimodal models.
This framework helps AI researchers and developers train large models that can understand and generate text based on both images and language inputs. You can feed it a combination of images and text, and it produces new, relevant text—like a caption for an image or an answer to a question about an image. It's designed for those building advanced AI systems that need to interpret and interact with the world through multiple modalities.
4,076 stars. No commits in the last 6 months.
Use this if you are an AI researcher or machine learning engineer looking to build or experiment with advanced multimodal AI models that process both visual and textual information.
Not ideal if you are looking for an out-of-the-box application for everyday tasks, as this is a foundational framework for model development rather than an end-user tool.
Stars
4,076
Forks
320
Language
Python
License
MIT
Category
Last pushed
Aug 31, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/mlfoundations/open_flamingo"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
open-mmlab/mmpretrain
OpenMMLab Pre-training Toolbox and Benchmark
facebookresearch/mmf
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
adambielski/siamese-triplet
Siamese and triplet networks with online pair/triplet mining in PyTorch
HuaizhengZhang/Awsome-Deep-Learning-for-Video-Analysis
Papers, code and datasets about deep learning and multi-modal learning for video analysis
KaiyangZhou/pytorch-vsumm-reinforce
Unsupervised video summarization with deep reinforcement learning (AAAI'18)