VachanVY/Transfusion.torch
PyTorch Implementation of Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
This project offers a unified model that can generate both text and images seamlessly. You provide it with a mix of text and image data, and it produces new sequences that can include text, images, or both, switching between them as needed. This is designed for AI researchers and developers who are building multi-modal generation systems.
No commits in the last 6 months.
Use this if you are a machine learning researcher or developer interested in building or experimenting with a single model that can both write text and create images.
Not ideal if you are looking for an off-the-shelf application to generate text and images without deep technical implementation, as this is a foundational model.
Stars
28
Forks
5
Language
Python
License
MIT
Category
Last pushed
Oct 10, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/VachanVY/Transfusion.torch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NVlabs/MambaVision
[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
sign-language-translator/sign-language-translator
Python library & framework to build custom translators for the hearing-impaired and translate...
kyegomez/Jamba
PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
autonomousvision/transfuser
[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving;...
kyegomez/MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance...