KolosalAI/Kolosal
Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.
This desktop application helps individuals and businesses run large language models (LLMs) like Mistral or LLaMA directly on their own computer or small devices without needing an internet connection or costly cloud services. It takes your chosen LLM and allows you to use it for tasks like content generation or analysis, keeping all your data private. This is ideal for anyone who needs to use AI locally for privacy, cost savings, or deployment on edge devices.
440 stars. No commits in the last 6 months.
Use this if you need to run, train, or deploy large language models offline, keep your data private, or reduce costs by avoiding cloud computing.
Not ideal if you need a fully managed cloud solution or are looking for a platform that doesn't focus on local or edge device deployment.
Stars
440
Forks
29
Language
C++
License
Apache-2.0
Category
Last pushed
May 22, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/KolosalAI/Kolosal"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.