All LLM Inference Engines

145 engines ranked by quality score · Page 2 of 2

Showing 101–145 of 145

« Prev

#	Engine	Score	Tier	Category	Stars	Language
101	vijaytank/eclipsellama Privacy-first AI coding assistant for Eclipse (Ollama)	35	Emerging	—	4	Java
102	chocks/locode Local-first AI coding CLI. Routes simple tasks to a local LLM (Ollama),...	34	Emerging	—	23	TypeScript
103	ARPAHLS/micro-f1-mask Zero-Latency PII Scrubbing Middleware Agent for Enterprise Cloud Compliance.	34	Emerging	—	10	Python
104	Entropic-Science/qr-sampler Integrate any source of randomness into LLM token sampling. Easily create...	33	Emerging	—	13	Python
105	mlco2/ecologits-api 🌱 Estimate the environmental footprint of GenAI with EcoLogits API	32	Emerging	—	4	Python
106	0xMMA/KeyLint Fix text instantly with AI — one hotkey, perfect writing. Supports OpenAI,...	32	Emerging	—	4	TypeScript
107	thenetcircle/logistik Machine learning logistics and serving platform	32	Emerging	—	4	JavaScript
108	argeo/argeo-jjml Java bindings for the ggml family of machine learning libraries, especially...	32	Emerging	—	4	Java
109	whereclaw/whereclaw OpenClaw one-click installation & Running local models	32	Emerging	—	3	Rust
110	Resk-Security/resk-llm-ts A comprehensive security toolkit for JavaScript applications using Large...	32	Emerging	—	7	TypeScript
111	upioneer/homelab Collection of apps and utilities for automation and homelab	31	Emerging	—	3	—
112	PrzemyslawSwiderski/python-uv-gradle-plugin Gradle Plugin for Python projects using uv tool	30	Emerging	—	6	Kotlin
113	MekayelAnik/vllm-cpu Wheels & Docker images for running vLLM on CPU-only systems, optimized for...	30	Emerging	—	6	Shell
114	clanker-lover/codedocent Code visualization for non-programmers. A docent for your codebase.	29	Experimental	—	9	Python
115	crstian19/llamit A VS Code extension to generate semantic commit messages using your local...	29	Experimental	—	9	TypeScript
116	JoelHJames1/Nexus-Inference-Engine- NEXUS: Production C++ inference engine for Apple Silicon. Run 400B+ LLMs on...	29	Experimental	—	3	C++
117	ascarola/verdictmail AI-powered email threat analysis daemon — IMAP IDLE monitoring,...	28	Experimental	—	5	Python
118	PeterVanPercson/buildcored-orcas A 30-day build challenge for people who can execute under pressure. You will...	27	Experimental	—	36	Python
119	Sagargupta16/ai-git-hooks AI-powered git hooks - auto-review diffs, generate commit messages, scan for...	27	Experimental	—	3	Shell
120	Saisathvik94/codemaxx CodeMaxx – AI-powered tool to explain, fix, and improve your code. CodeMaxx...	27	Experimental	—	3	Go
121	boxxy-dev/boxxy Stupid Linux Terminal	27	Experimental	—	66	Rust
122	Olawoyin007/intentKeeper A digital bodyguard for your mind - local-first content filter that...	27	Experimental	—	4	Python
123	AlexHettle/MeadowPy Beginner-friendly Python IDE with local AI features, teaching tools,...	27	Experimental	—	3	Python
124	SysAdminDoc/project-nomad-desktop Cross-platform desktop edition fork of Project N.O.M.A.D with more features...	27	Experimental	—	9	JavaScript
125	wshm-dev/wshm AI-powered repository agent for GitHub, GitLab, Gitea, Azure DevOps. Issue...	27	Experimental	—	11	Rust
126	msaad00/cloud-security Closed-loop cloud security benchmarks and remediation — 5 skills, 114 tests,...	27	Experimental	—	3	Python
127	PradyX/pocket_llm A privacy-first on-device LLM chat app built with Flutter.	27	Experimental	—	3	Dart
128	jjhickman/garbanzo-bot Run AI-powered community operations in chat: orchestrate...	27	Experimental	—	4	TypeScript
129	managelm/linux-windows-agent Lightweight agent for Linux & Windows — natural language server management...	26	Experimental	—	7	—
130	tsunamayo7/helix-agent Extend Claude Code with local Ollama models — autonomous ReAct agent with...	26	Experimental	—	5	Python
131	linyeping/GemMate Your sovereign, zero-cost AI study companion—running Gemma 4 entirely on...	25	Experimental	—	4	Dart
132	kennedyraju55/90-local-llm-projects 🚀 90 Production-Level Projects Built with Local LLM (Gemma 4 + Ollama) -...	25	Experimental	—	3	Python
133	b-iurea/freelens-ollama-extension Freelens plugin that allow to use local Ollama LLM models with particular...	25	Experimental	—	4	TypeScript
134	SteveYang05/Mood_Land Moodland — offline-friendly desktop companion with local vision and chat;	25	Experimental	—	4	TypeScript
135	benmezger/daily-summary Generate daily summaries based on Github PR/Issues using (optionally) Ollama.	25	Experimental	—	7	Python
136	mahadillahm4di-cyber/mh-gdpr-ai.eu-s-plus Switch GPT ↔ Claude ↔ Llama, never lose context. Your AI brain as 3D stars....	25	Experimental	—	3	Go
137	BrainDriveAI/BrainDrive A personal AI system that helps you define, set, and reach your goals....	25	Experimental	—	3	TypeScript
138	zigotica/tilde git bare repo to hold my .bash_profile and .config folder (bash, custom bin...	24	Experimental	—	4	Shell
139	OzuYatamutsu/project-overengineer An overengineered AI cloud service built for reliability.	23	Experimental	—	3	TypeScript
140	kubawer21/StealthIt 🛠️ Enhance productivity with StealthIt, a hidden AI utility for screen...	21	Experimental	—	3	Python
141	94BILLY/NOVA NOVA: A high-performance, bare-metal Win32 C++17 desktop orchestrator....	20	Experimental	—	7	C++
142	przchojecki/agentic-erdos Agentic workflow for tackling all open Erdos problems at once.	19	Experimental	—	3	JavaScript
143	ParthSareen/OllamaClaw A minimal take on OpenClaw using Ollama	17	Experimental	—	4	Go
144	shiinamiyuki/sm120_gemm A Zero-dependency GEMM library for RTX 50 series (SM120). 100% cuBLAS performance.	17	Experimental	—	4	Cuda
145	Orellius/orellius-cortex-terminal AI-first multi-model terminal. Claude + Ollama + MCP tools in one interface....	12	Experimental	—	4	TypeScript

« Prev 1 2