av/awesome-llm-services
A list of self-hostable LLM services
This is a curated list of over 117 open-source tools and services for running AI models on your own servers or personal computers. It helps you find self-hostable options for everything from chat interfaces and AI agents to backend inference engines and audio processing. The target audience is typically a 'homelab' enthusiast, IT manager, or operations engineer who wants to deploy and manage AI services independently.
Use this if you need to find an open-source, self-hostable AI service or tool to integrate into your existing infrastructure or personal setup.
Not ideal if you are looking for ready-to-use, managed AI services or specific model weights.
Stars
83
Forks
5
Language
TypeScript
License
MIT
Category
Last pushed
Mar 09, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/av/awesome-llm-services"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
rafska/awesome-local-llm
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
KalyanKS-NLP/llm-engineer-toolkit
A curated list of 120+ LLM libraries category wise.
yzhao062/anomaly-detection-resources
Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM...
llm-jp/awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
InftyAI/Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.