yassa9/qwen600
Static suckless single batch CUDA-only qwen3-0.6B mini inference engine
This is a specialized tool for developers working with large language models. It provides a highly optimized, minimalist inference engine for the Qwen3-0.6B instruct model, allowing developers to run this specific model on their NVIDIA GPUs. It takes the model's weights and a prompt as input and outputs generated text, often faster than other solutions, making it ideal for those who need to integrate this model into custom applications.
546 stars. No commits in the last 6 months.
Use this if you are a developer seeking a very fast, low-dependency way to run the Qwen3-0.6B LLM on an NVIDIA GPU for integration into your own C/C++ projects.
Not ideal if you are looking for a general-purpose LLM interface, support for various models, or a Python-centric development environment.
Stars
546
Forks
48
Language
Cuda
License
MIT
Category
Last pushed
Sep 08, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/yassa9/qwen600"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
QwenLM/Qwen
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
LLM-Red-Team/qwen-free-api
🚀...
QwenLM/Qwen-VL
The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by...
willbnu/Qwen-3.5-16G-Vram-Local
Configs, launchers, benchmarks, and tooling for running Qwen3.5 GGUF models locally with...
QwenLM/qwen.cpp
C++ implementation of Qwen-LM