vlvink/PaliGemma-from-scratch
PaliGemma is a project created from scratch, based on a YouTube guide, to learn and demonstrate application/library/system creation. The project uses modern development approaches and best practices from the original tutorial.
This project offers a from-scratch implementation of PaliGemma, a multimodal vision language model. It takes an image and text prompt as input and generates a relevant text response. This tool is designed for machine learning engineers and researchers who want to understand the inner workings of multimodal models and enhance their PyTorch programming skills.
No commits in the last 6 months.
Use this if you are a machine learning engineer or researcher looking to deepen your understanding of how multimodal (vision-language) models are built and want to practice implementing them in PyTorch.
Not ideal if you are an end-user simply looking to apply an existing vision-language model for tasks like image captioning or visual question answering without delving into its codebase.
Stars
7
Forks
—
Language
Python
License
—
Category
Last pushed
Jan 19, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/generative-ai/vlvink/PaliGemma-from-scratch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NVIDIA-NeMo/NeMo
A scalable generative AI framework built for researchers and developers working on Large...
alexiglad/EBT
PyTorch Code for Energy-Based Transformers paper -- generalizable reasoning and scalable learning
vlm-run/vlmrun-hub
A hub for various industry-specific schemas to be used with VLMs.
HyperGAI/HPT
HPT - Open Multimodal LLMs from HyperGAI
yash9439/Falcon-Local-AI-Model
Explore this GitHub repository housing 3 versions of Falcon code for text generation. Each...