arozanov/turboquant-mlx

TurboQuant KV cache compression for MLX with fused Metal kernels. 4.6x compression at 98% FP16 speed.

40
/ 100
Emerging
No License No Package No Dependents
Maintenance 13 / 25
Adoption 9 / 25
Maturity 1 / 25
Community 17 / 25

How are scores calculated?

Stars

75

Forks

14

Language

Python

License

Last pushed

Apr 02, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/arozanov/turboquant-mlx"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.