hesamsheikh/llm-mechanics
Coding an LLM and its building blocks from scratch.
This project is a personal learning environment for those who want to understand the foundational mechanics of large language models (LLMs). It helps you learn how LLMs and their core components are built from the ground up using PyTorch. This is for machine learning engineers, researchers, or students who are curious about the inner workings of AI language models.
116 stars. No commits in the last 6 months.
Use this if you are a machine learning practitioner who wants to deeply understand the theoretical and practical implementation details of LLMs by building them from first principles.
Not ideal if you are looking to apply pre-built LLMs for specific tasks like content generation, data summarization, or chatbot development.
Stars
116
Forks
17
Language
Jupyter Notebook
License
—
Category
Last pushed
Mar 27, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/hesamsheikh/llm-mechanics"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AI-Hypercomputer/maxtext
A simple, performant and scalable Jax LLM!
rasbt/reasoning-from-scratch
Implement a reasoning LLM in PyTorch from scratch, step by step
mindspore-lab/mindnlp
MindSpore + 🤗Huggingface: Run any Transformers/Diffusers model on MindSpore with seamless...
mosaicml/llm-foundry
LLM training code for Databricks foundation models
rickiepark/llm-from-scratch
<밑바닥부터 만들면서 공부하는 LLM>(길벗, 2025)의 코드 저장소