Local Llm Deployment LLM Tools
There are 9 local llm deployment tools tracked. The highest-rated is pleisto/flappy at 40/100 with 307 stars.
Get all 9 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=local-llm-deployment&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Tool | Score | Tier |
|---|---|---|---|
| 1 |
pleisto/flappy
Production-Ready LLM Agent SDK for Every Developer |
|
Emerging |
| 2 |
coderonion/awesome-rust-list
This repository lists some awesome public Rust projects, Videos, Blogs and Jobs. |
|
Experimental |
| 3 |
excorsistvoid/Neuro-Bridge
🔗 Enable seamless hardware access on Android with Neuro-Bridge, a... |
|
Experimental |
| 4 |
mvrilo/goprivategpt
privategpt implemented with Go |
|
Experimental |
| 5 |
0xricksanchez/AIonic
AIonic: A unified, user-friendly Rust library for seamless integration with... |
|
Experimental |
| 6 |
codewithosama03/openrouter-free-model
🌐 Explore and manage free models on OpenRouter with this web app, featuring... |
|
Experimental |
| 7 |
OnlyF0uR/interactive-ai
Rust CLI application for interacting with LLMs for Llama & OpenRouter. |
|
Experimental |
| 8 |
Inferra/Inferra-JS-SDK
Official JavaScript/TypeScript SDK for Inferra API access |
|
Experimental |
| 9 |
bdqfork/go-llama.cpp
go binding for llama.cpp, offer low level and high level api |
|
Experimental |