Kv Cache Optimization MLOps Tools
There are 2 kv cache optimization tools tracked. 1 score above 70 (verified tier). The highest-rated is ovg-project/kvcached at 79/100 with 804 stars and 143 monthly downloads. 1 of the top 10 are actively maintained.
Get all 2 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=kv-cache-optimization&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Tool | Score | Tier |
|---|---|---|---|
| 1 |
ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond |
|
Verified |
| 2 |
InftyAI/Manta
💫 A lightweight p2p-based cache system for model distributions on... |
|
Experimental |