Kv Cache Optimization Embedding Tools

There are 4 kv cache optimization tools tracked. The highest-rated is Zefan-Cai/R-KV at 46/100 with 1,183 stars.

Get all 4 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=embeddings&subcategory=kv-cache-optimization&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 Zefan-Cai/R-KV

[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

46
Emerging
2 snu-mllab/KVzip

[NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory...

44
Emerging
3 codefuse-ai/ModelCache

A LLM semantic caching system aiming to enhance user experience by reducing...

43
Emerging
4 philtimmes/KeSSie

KeSSie HUGE Context Semantic recall for Large Language Models

25
Experimental