rickiepark/llm-from-scratch

This project provides the official code repository for the book "LLM From Scratch" (Gilbut, 2025). It helps you understand how large language models (LLMs) like GPT work internally by guiding you through coding them step-by-step from the ground up. You'll input explanations, diagrams, and examples, and output a functional, albeit small, LLM that you can pre-train and fine-tune. This is for anyone, particularly data scientists, machine learning engineers, or researchers, who wants a deep, hands-on understanding of LLM architecture and development.