Ekoda/LanguageModelFromScratch

An autoregressive transformer language model from first principles, built without relying on ML libraries. Inspired by Vaswani et al.'s seminal 2017 work, "Attention Is All You Need".

11
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 0 / 25
Maturity 11 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Python

License

MIT

Category

transformer-architecture-education

Last pushed

Jun 02, 2024

Commits (30d)

0

GitHub
Transformer Architecture Education · 26 frameworks

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Ekoda/LanguageModelFromScratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

lvapeab/nmt-keras

Neural Machine Translation with Keras

51

dair-ai/Transformers-Recipe

🧠 A study guide to learn about Transformers

46

SirawitC/Transformer_from_scratch_pytorch

Build a transformer model from scratch using pytorch to understand its inner workings and gain...

44

jaketae/ensemble-transformers

Ensembling Hugging Face transformers made easy

42

lof310/transformer

PyTorch implementation of the current SOTA Transformer. Configurable, efficient, and...

39

Explore ML Frameworks

All categories Trending ML Framework directory Insights