romitjain/awesome-llm-systems
This repository aims to consolidate resources for learning about systems for LLM
This collection of resources helps you understand how large language models (LLMs) are built and optimized for performance. It compiles essential blogs and papers covering topics from GPU computing to advanced inference techniques. This is for AI/ML engineers and researchers who want to gain fundamental or intermediate knowledge in designing and scaling LLM systems.
Use this if you are an AI/ML engineer or researcher looking for curated resources to deepen your understanding of LLM system architecture, optimization, and deployment.
Not ideal if you are looking for an off-the-shelf tool or code library to implement an LLM, rather than educational materials on its underlying systems.
Stars
14
Forks
—
Language
—
License
—
Category
Last pushed
Feb 04, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/romitjain/awesome-llm-systems"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
thu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency,...
NotPunchnox/rkllama
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning...
sophgo/LLM-TPU
Run generative AI models in sophgo BM1684X/BM1688
Deep-Spark/DeepSparkHub
DeepSparkHub selects hundreds of application algorithms and models, covering various fields of...
howard-hou/VisualRWKV
VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle...