Kv Cache Optimization Embedding Tools

There are 3 kv cache optimization tools tracked. The highest-rated is Zefan-Cai/R-KV at 40/100 with 1,183 stars.

Get all 3 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=embeddings&subcategory=kv-cache-optimization&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 Zefan-Cai/R-KV

[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

40
Emerging
2 snu-mllab/KVzip

[NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory...

38
Emerging
3 codefuse-ai/ModelCache

A LLM semantic caching system aiming to enhance user experience by reducing...

36
Emerging