Pelochus/ezrknpu
Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs
This helps hardware enthusiasts and developers leverage the Neural Processing Unit (NPU) in Rockchip RK3588 and RK3588S powered single-board computers. It streamlines the setup for running large language models (like ChatGPT-style LLMs) and other neural network applications directly on your device. You feed it converted model files (e.g., .rkllm format) and it enables local execution for various AI tasks.
231 stars. No commits in the last 6 months.
Use this if you want to easily install the necessary software to run AI models, including large language models, on your Rockchip RK3588 or RK3588S powered device.
Not ideal if you are looking to run AI models on other Rockchip SoCs, Android, or don't have a device with an RK3588 or RK3588S chip.
Stars
231
Forks
17
Language
Shell
License
GPL-3.0
Category
Last pushed
Aug 03, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Pelochus/ezrknpu"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
thu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency,...
sophgo/LLM-TPU
Run generative AI models in sophgo BM1684X/BM1688
NotPunchnox/rkllama
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning...
Deep-Spark/DeepSparkHub
DeepSparkHub selects hundreds of application algorithms and models, covering various fields of...
howard-hou/VisualRWKV
VisualRWKV is the visual-enhanced version of the RWKV language model, enabling RWKV to handle...