kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
AIKit simplifies running and customizing large language models (LLMs) on your own infrastructure. It takes various open-source LLMs as input and outputs a deployable, fine-tuned model that can be accessed via an OpenAI-compatible API. This tool is for software engineers or DevOps professionals who need to integrate, host, or adapt LLMs within their existing systems securely and efficiently.
512 stars. Actively maintained with 26 commits in the last 30 days.
Use this if you need to run, fine-tune, or deploy open-source large language models in an on-premise or private cloud environment without relying on external cloud providers for inference.
Not ideal if you are an end-user simply looking to chat with an LLM and do not have technical expertise in deploying containerized applications.
Stars
512
Forks
57
Language
Go
License
MIT
Category
Last pushed
Mar 11, 2026
Commits (30d)
26
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/kaito-project/aikit"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.