edgenai/edgen
⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.
Edgen provides a local, private server for running generative AI models directly on your computer, without needing a powerful graphics card or an internet connection. It takes your text inputs for generating responses or audio files for transcription, and delivers AI-powered outputs, all while keeping your data securely on your device. This is ideal for developers building applications that need AI capabilities but prioritize user privacy and offline functionality.
371 stars. No commits in the last 6 months.
Use this if you are a developer building an application and want to integrate generative AI features like chat completions or speech-to-text, ensuring user data privacy by processing everything locally on their device.
Not ideal if you need access to the absolute latest, largest, or most specialized cloud-based AI models that require significant computational resources or if you are not comfortable integrating APIs into your applications.
Stars
371
Forks
20
Language
Rust
License
Apache-2.0
Category
Last pushed
May 23, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/edgenai/edgen"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ParisNeo/lollms-webui
Lord of Large Language and Multi modal Systems Web User Interface
ggozad/oterm
the terminal client for Ollama
owndev/Open-WebUI-Functions
Open-WebUI-Functions is a collection of custom pipelines, filters, and integrations designed to...
hand-e-fr/OpenHosta
A lightweight library integrating LLM natively into Python
lmg-anon/mikupad
LLM Frontend in a single html file