litgpt and llm-gpt
One project offers a comprehensive framework for training and deploying high-performance LLMs at scale, while the other provides a step-by-step, hands-on guide to building foundational NLP algorithms and early language models, making them complementary for different learning and implementation goals.
About litgpt
Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
This project helps machine learning engineers and researchers build custom large language models. You can select from over 20 pre-built LLMs, feed in your specific datasets for training or fine-tuning, and then deploy these models for various applications. It's designed for users who need fine-grained control and high performance for their custom AI language tasks.
About llm-gpt
huangjia2019/llm-gpt
From classic NLP to modern LLMs: building language models step by step. 异步图书：《 GPT图解 大模型是怎样构建的》- 这套代码是AI Coder出现之前，自己用纯手工搭建的一套简单有效的NLP经典算法集合。在大语言模型推动的AI Coder兴起之后，很少有机会再创作这么有“手工风”的代码了，不知道这是值得开心还是值得遗憾的事情。
This project helps you understand and build language models from the ground up, moving from traditional natural language processing (NLP) to modern large language models (LLMs). You'll start with fundamental NLP concepts and progress to constructing sophisticated language models. This is ideal for students, researchers, or anyone in the AI field looking to deeply grasp the underlying mechanics of how these models work.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work