Trending LLM Inference Engines

Engines with the biggest quality score improvements over the last 3 days.

#	Engine	Change	Score	Tier	Category	Stars
1	nordwestt/ollama-ai-provider-v2 Vercel AI Provider for running LLMs locally using Ollama	+22	80	Verified	—	99
2	georgiosnikitas/brain-break 🧠🔨 Brain Break is an AI-powered terminal quiz app.	+17	46	Emerging	—	11
3	tripolskypetr/agent-swarm-kit A TypeScript library for building orchestrated framework-agnostic...	+17	70	Verified	—	36
4	OEvortex/Webscout Webscout is the all-in-one search and AI toolkit you need. Discover insights...	+17	77	Verified	—	336
5	webgptorg/promptbook Turn your company's scattered knowledge into AI ready Books ✨	+17	69	Established	—	155
6	superagentxai/superagentx Move from idea to production in hours with policy-driven autonomous AI...	+16	76	Verified	—	186
7	geeks-accelerator/ollama-herd Smart inference router that herds your Ollama instances into one endpoint....	+16	44	Emerging	—	7
8	mnvsk97/eyeroll AI eyes that roll through video footage — watch, understand, act	+16	50	Established	—	8
9	anirbanbasu/ollama-downloader A library and Hugging Face model downloader for Ollama.	+14	58	Established	—	5
10	ArvinLovegood/go-stock 🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体...	+12	75	Verified	—	5,230
11	alichherawalla/off-grid-mobile-ai The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images -...	+12	64	Established	—	1,444
12	The-Focus-AI/umwelten CLI tool for evaluating and comparing AI models across Google, Ollama,...	+12	44	Emerging	—	3
13	clidey/whodb A lightweight next-gen data explorer - Postgres, MySQL, SQLite, MongoDB,...	+12	68	Established	—	4,713
14	flashinfer-ai/flashinfer FlashInfer: Kernel Library for LLM Serving	+12	74	Verified	—	5,365
15	ruvnet/RuVector RuVector is a High Performance, Real-Time, Self-Learning, Vector GNN, Memory...	+12	69	Established	—	3,770
16	ParisNeo/lollms_hub A proxy server for multiple ollama instances with Key security	+12	73	Verified	—	614
17	1Panel-dev/1Panel 🔥 1Panel is a modern, open-source VPS control panel — and the only one with...	+12	70	Verified	—	34,884
18	n4ze3m/page-assist Use your locally running AI models to assist you in your web browsing	+10	69	Established	—	7,756
19	kubernetes-sigs/lws LeaderWorkerSet: An API for deploying a group of pods as a unit of replication	+10	74	Verified	—	693
20	Gsync/jobsync JobSync is a self-hosted, open-source job application tracker and AI-powered...	+10	70	Verified	—	503
21	Kochava-Studios/witsy Witsy: desktop AI assistant / universal MCP client	+10	68	Established	—	1,932
22	otwld/ollama-helm Helm chart for Ollama on Kubernetes	+7	67	Established	—	564
23	xlite-dev/Awesome-LLM-Inference 📚A curated list of Awesome LLM/VLM Inference Papers with Codes:...	+7	64	Established	—	5,135
24	control-theory/gonzo Gonzo! The Go based TUI log analysis tool	+7	60	Established	—	2,571
25	Jeffser/Alpaca 🦙 Local and online AI hub	+7	65	Established	—	1,486
26	aws-samples/swift-chat A lightning-fast, cross-platform AI Assistant App built with React Native.	+7	67	Established	—	780
27	Epistates/pmetal Powdered Metal — High performance LLM fine-tuning framework for Apple Silicon	+7	52	Established	—	218
28	uwuclxdy/ollama-lmstudio-proxy Access LM Studio through Ollama API.	+3	43	Emerging	—	11
29	whereclaw/whereclaw OpenClaw one-click installation & Running local models	+2	32	Emerging	—	3