BodhiSearch/BodhiApp
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
Bodhi App helps you run open-source large language models (LLMs) on your own computer, so you can chat with them or integrate them into your applications without needing external services. It takes your text prompts and selected LLM, then provides conversational responses or API outputs directly. This tool is for anyone, from individual users wanting to experiment with AI to developers building applications, who needs to use LLMs privately or with specific open-source models.
132 stars.
Use this if you want to run open-source LLMs like Llama 3 or Mistral on your local machine for personal use or to power your applications, without relying on external cloud services.
Not ideal if you need access to proprietary models like advanced GPT versions or Gemini, or if you prefer a fully managed, cloud-based LLM solution.
Stars
132
Forks
9
Language
Rust
License
—
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/BodhiSearch/BodhiApp"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.