InftyAI/Awesome-LLMOps
π An awesome & curated list of best LLMOps tools.
This is a curated list of tools for managing and deploying Large Language Models (LLMs) in a production environment. It helps engineers and machine learning practitioners find solutions for common tasks like running LLMs efficiently, orchestrating complex AI applications, and training or fine-tuning models. It takes in a need to implement an LLM-based solution and outputs a selection of suitable tools for different stages of the LLM lifecycle.
215 stars.
Use this if you are a machine learning engineer, MLOps specialist, or AI developer looking for specific tools to build, deploy, or manage large language models.
Not ideal if you are an end-user seeking to understand what LLMs can do for your business, or if you are looking for introductory material on AI concepts.
Stars
215
Forks
40
Language
Python
License
Apache-2.0
Category
Last pushed
Feb 04, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/InftyAI/Awesome-LLMOps"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
rafska/awesome-local-llm
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
KalyanKS-NLP/llm-engineer-toolkit
A curated list of 120+ LLM libraries category wise.
yzhao062/anomaly-detection-resources
Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM...
llm-jp/awesome-japanese-llm
ζ₯ζ¬θͺLLMγΎγ¨γ - Overview of Japanese LLMs
CHIANGEL/Awesome-LLM-for-RecSys
Survey: A collection of AWESOME papers and resources on the large language model (LLM) related...