BubbleJoe-BrownU/TransformerHub
This is a repository of transformer-like models, including Transformer, GPT, BERT, ViT and much more to be implemented along my journey into the fascinating deep learning field.
This is a collection of fundamental transformer model architectures like GPT, BERT, and ViT, showcasing how they are built and designed. It provides a structured way to understand the internal workings of these models, from their attention mechanisms to positional embeddings. It is primarily for deep learning practitioners, students, and researchers who want to learn the underlying code implementations.
No commits in the last 6 months.
Use this if you are a deep learning student or researcher looking for reference implementations of core transformer models to understand their architecture and advanced programming techniques.
Not ideal if you need state-of-the-art models for immediate application in real-world tasks, as these are primarily for educational and reference purposes.
Stars
87
Forks
16
Language
Python
License
—
Category
Last pushed
Mar 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/BubbleJoe-BrownU/TransformerHub"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lucidrains/x-transformers
A concise but complete full-attention transformer with a set of promising experimental features...
kanishkamisra/minicons
Utility for behavioral and representational analyses of Language Models
lucidrains/simple-hierarchical-transformer
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
lucidrains/dreamer4
Implementation of Danijar's latest iteration for his Dreamer line of work
Nicolepcx/Transformers-in-Action
This is the corresponding code for the book Transformers in Action