rasbt/LLM-workshop-2024
A 4-hour coding workshop to understand how LLMs are implemented and used
This workshop helps coders understand and build large language models (LLMs) from the ground up. You will learn how to code a small GPT-like LLM, including its data input, core architecture, and pretraining process. It's designed for developers who want to grasp the inner workings and implementation of LLMs.
1,074 stars. No commits in the last 6 months.
Use this if you are a coder who wants to understand the foundational building blocks of LLMs and how to implement them in PyTorch.
Not ideal if you are looking for a high-level overview of LLM applications without diving into the code and implementation details.
Stars
1,074
Forks
377
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Jan 13, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/rasbt/LLM-workshop-2024"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
PacktPublishing/Mastering-NLP-from-Foundations-to-LLMs
Mastering NLP from Foundations to LLMs, Published by Packt
HandsOnLLM/Hands-On-Large-Language-Models
Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
mlabonne/llm-course
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
louisfb01/start-llms
A complete guide to start and improve your LLM skills in 2026 with little background in the...
Denis2054/Transformers-for-NLP-and-Computer-Vision-3rd-Edition
Transformers 3rd Edition