Transformer Implementation Education Generative AI Tools

Educational repositories focused on building transformer and language models from scratch for learning purposes. Includes minimal implementations, tutorials, and foundational architecture experiments. Does NOT include production-ready model deployments, fine-tuned applications, or domain-specific use cases like translation services or myth generation.

There are 27 transformer implementation education tools tracked. 1 score above 70 (verified tier). The highest-rated is NVIDIA-NeMo/NeMo at 73/100 with 16,894 stars. 1 of the top 10 are actively maintained.

Get all 27 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=generative-ai&subcategory=transformer-implementation-education&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	NVIDIA-NeMo/NeMo A scalable generative AI framework built for researchers and developers...	73	Verified	16,894	Python
2	alexiglad/EBT PyTorch Code for Energy-Based Transformers paper -- generalizable reasoning...	55	Established	613	Python
3	vlm-run/vlmrun-hub A hub for various industry-specific schemas to be used with VLMs.	52	Established	541	Python
4	HyperGAI/HPT HPT - Open Multimodal LLMs from HyperGAI	39	Emerging	313	Python
5	yash9439/Falcon-Local-AI-Model Explore this GitHub repository housing 3 versions of Falcon code for text...	34	Emerging	6	Python
6	bastien-muraccioli/svlr SVLR: Scalable, Training-Free Visual Language Robotics: a modular...	32	Emerging	15	Python
7	DorsaRoh/transformer-from-scratch Complete transformer from scratch, using only numpy	25	Experimental	41	Jupyter Notebook
8	rajchauhan28/nano-llm Training a Language Model from Scratch on Consumer Hardware	22	Experimental	1	Python
9	Fabri-D/MythGenerator GPT-2 fine-tuned model for myth generation using curated mythological...	21	Experimental	—	Python
10	binarybrains-club/HugginFace-Community Se detallarán los pasos para unirse a la comunidad de Hugging Face 🤗 , así...	21	Experimental	5	Jupyter Notebook
11	patrickamadeus/vqa-nle-llava Novel approach that leverages LVLMs to efficiently generate high-quality...	19	Experimental	3	Python
12	KennethanCeyer/diy-generative-ai-lm Make your Generative AI LM model from the scratch (Including pretraining /...	19	Experimental	16	Python
13	AstraBert/distilgpt2-finetuned-microbiology Small model for language modeling based on distilgpt2 and on...	19	Experimental	3	Python
14	RohitPawar001/Build_your_custom_LLM This repository will allow you to create your own LLM model by only using Terminal.	18	Experimental	1	Python
15	ankitdhall/torchsmith Torchsmith is a minimalist library that focuses on understanding generative...	17	Experimental	—	Python
16	gemaakhbar/paligemma-from-scratch 🌟 Build a PyTorch implementation of Google's PaliGemma model for advanced...	15	Experimental	—	Python
17	ariuz14/ProMoE 🚀 Enhance transformer performance with ProMoE, a framework that integrates...	14	Experimental	—	—
18	Motamensalih/HuggingFace-Task-Explorer Application for exploring different tasks and models in HuggingFace hub.	13	Experimental	—	Python
19	NvirAdan/Hybrid-Tiny-Transformer Hybrid Tiny Transformer trained on the dataset of all Shakespeare, built...	13	Experimental	—	Jupyter Notebook
20	vlvink/PaliGemma-from-scratch PaliGemma is a project created from scratch, based on a YouTube guide, to...	12	Experimental	7	Python
21	Akshat-afk/Transformer 🧠 A from-scratch Transformer implementation for educational and...	12	Experimental	3	Jupyter Notebook
22	nikhilr612/tralinz Experimenting with Transformers and Attention using Burn	11	Experimental	—	Rust
23	blandfort/perspectival A Python-based toolkit for comparing transformers.	11	Experimental	—	Python
24	mahshid1378/NeMo A scalable generative AI framework built for researchers and developers...	11	Experimental	—	Python
25	hallvardnmbu/transformer Modern applied deep learning with Transformer model methodology.	10	Experimental	2	Jupyter Notebook
26	FelixiaV/Iterative-GPT-QE- A hybrid framework that combines GPT-based sequence modeling with quantum...	10	Experimental	1	Python
27	manunair1990/Phi3-Vision-huggingface This repository contains Python code for performing vision tasks using the...	10	Experimental	2	Python