josStorer/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
This tool helps individuals and small businesses easily run powerful large language models (LLMs) on their own computers without complex setup. You put in a lightweight program, and it gives you a functioning LLM that can generate text, answer questions, or handle other language tasks. Anyone who wants to experiment with or deploy open-source LLMs without being an AI expert would use this.
6,256 stars. Actively maintained with 1 commit in the last 30 days.
Use this if you want to quickly set up and manage an open-source large language model (RWKV) on your local machine, compatible with existing ChatGPT client applications.
Not ideal if you need a cloud-based, massively scalable LLM solution, or if you prefer to build LLM integrations from scratch with raw libraries.
Stars
6,256
Forks
598
Language
TypeScript
License
MIT
Category
Last pushed
Feb 18, 2026
Commits (30d)
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/josStorer/RWKV-Runner"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the...
jordanhubbard/nanolang
A tiny experimental language designed to be targeted by coding LLMs
waybarrios/vllm-mlx
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models...
akivasolutions/tightwad
Pool your CUDA + ROCm GPUs into one OpenAI-compatible API. Speculative decoding proxy gives you...
petrukha-ivan/mlx-swift-structured
Structured output generation in Swift