icppWorld/icgpt
on-chain LLMs for the Internet Computer
This project helps developers integrate and deploy large language models (LLMs) like Llama and Qwen onto the Internet Computer (IC) blockchain. It provides the tools and instructions to set up an on-chain LLM backend, allowing users to interact with these models directly through a decentralized network. The primary users are developers looking to build decentralized applications (dApps) that require robust, on-chain AI capabilities.
Use this if you are a developer aiming to deploy and run large language models as decentralized services on the Internet Computer blockchain.
Not ideal if you are an end-user looking for a ready-to-use AI chatbot or if you prefer off-chain or centralized LLM deployments.
Stars
17
Forks
2
Language
Python
License
MIT
Category
Last pushed
Jan 14, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/icppWorld/icgpt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the...
josStorer/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface...
jordanhubbard/nanolang
A tiny experimental language designed to be targeted by coding LLMs
waybarrios/vllm-mlx
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models...
akivasolutions/tightwad
Pool your CUDA + ROCm GPUs into one OpenAI-compatible API. Speculative decoding proxy gives you...