icppWorld/icpp_llm
on-chain LLMs
This project helps decentralized application (dApp) developers integrate and run large language models (LLMs) directly on the Internet Computer blockchain. It takes smaller, specialized LLMs as input and deploys them as secure, on-chain components, allowing dApps to use generative AI features without relying on traditional cloud platforms. The primary users are blockchain developers and researchers building dApps on the Internet Computer.
Use this if you are a blockchain developer or researcher looking to build generative AI capabilities directly into your decentralized applications on the Internet Computer, benefiting from enhanced security and simplified deployment.
Not ideal if you need to run very large, general-purpose LLMs or if you are not developing on the Internet Computer blockchain.
Stars
19
Forks
5
Language
C++
License
MIT
Category
Last pushed
Jan 09, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/icppWorld/icpp_llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)