seasonjs/rwkv
pure go for rwkv
This is a Go programming library for integrating RWKV large language models into your applications. It takes a pre-trained RWKV model file and a text prompt as input, then generates text completions. This is designed for Go developers who want to embed efficient, cross-platform language model capabilities directly into their Go software.
No commits in the last 6 months.
Use this if you are a Go developer building an application that needs local, performant text generation capabilities powered by RWKV models, with support for various hardware configurations.
Not ideal if you are looking for a standalone application to use an RWKV model, rather than a programming library to build one.
Stars
19
Forks
3
Language
Go
License
MIT
Category
Last pushed
Dec 31, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/seasonjs/rwkv"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the...
josStorer/RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB. And provides an interface...
jordanhubbard/nanolang
A tiny experimental language designed to be targeted by coding LLMs
waybarrios/vllm-mlx
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models...
akivasolutions/tightwad
Pool your CUDA + ROCm GPUs into one OpenAI-compatible API. Speculative decoding proxy gives you...