awesome-local-llm and Awesome-LLMOps
These are **complements** — running LLMs locally (A) requires operational tooling and monitoring to manage them effectively in production, which is precisely what LLMOps tools (B) provide.
About awesome-local-llm
rafska/awesome-local-llm
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
This is a curated collection of resources for running large language models (LLMs) on your own computer or local infrastructure. It provides access to various platforms, tools, and models that allow you to process natural language input and generate text, code, or even images and audio locally. This resource is for developers, researchers, and hobbyists who want to leverage LLMs without relying on external cloud services.
About Awesome-LLMOps
InftyAI/Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.
This is a curated list of tools for managing and deploying Large Language Models (LLMs) in a production environment. It helps engineers and machine learning practitioners find solutions for common tasks like running LLMs efficiently, orchestrating complex AI applications, and training or fine-tuning models. It takes in a need to implement an LLM-based solution and outputs a selection of suitable tools for different stages of the LLM lifecycle.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work