zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
kani is a lightweight and customizable framework for building conversational AI agents that can use tools. It allows developers to feed in prompts and receive responses, enabling language models to perform actions like fetching real-time data or interacting with other systems. This tool is for NLP researchers, hobbyists, and developers who want fine-grained control over their AI's behavior and integrations.
599 stars. Used by 2 other packages. Actively maintained with 8 commits in the last 30 days. Available on PyPI.
Use this if you are a developer building a custom chatbot or AI agent and need fine-grained control over how your language model interacts with external tools and data.
Not ideal if you are looking for a no-code solution or a pre-built application, as this is a developer framework requiring coding knowledge.
Stars
599
Forks
29
Language
Python
License
MIT
Category
Last pushed
Mar 04, 2026
Commits (30d)
8
Dependencies
1
Reverse dependents
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/zhudotexe/kani"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!