Dhyanesh18/llm-from-scratch

In this i have explored different parts of an LLM from the tokenizer to the attention mechanism to predicting tokens. I have also implemented the GPT2-small (124M) architecture using pytorch

10
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 1 / 25
Maturity 7 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Jupyter Notebook

License

—

Category

llm-implementation-from-scratch

Last pushed

Aug 23, 2025

Commits (30d)

0

GitHub
LLM Implementation From Scratch · 52 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/Dhyanesh18/llm-from-scratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

66

facebookresearch/LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

52

FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

52

kmeng01/rome

Locating and editing factual associations in GPT (NeurIPS 2022)

51

datawhalechina/llms-from-scratch-cn

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

48

Explore Transformer Models

All categories Trending Transformer directory Insights