burcgokden/PLDR-LLM-with-KVG-cache

Implementation of PLDR-LLM with KV-cache and G-cache in Pytorch for the paper titled "PLDR-LLMs Learn A Generalizable Tensor Operator That Can Replace Its Own Deep Neural Net At Inference"

10
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 1 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Python

License

Apache-2.0

Category

llm-compression-optimization

Last pushed

Mar 19, 2025

Commits (30d)

0

GitHub
LLM Compression Optimization · 30 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/burcgokden/PLDR-LLM-with-KVG-cache"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Tencent/AngelSlim

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

85

nebuly-ai/optimate

A collection of libraries to optimise AI model performances

45

kyo-takano/chinchilla

A toolkit for scaling law research ⚖

45

liyucheng09/Selective_Context

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40%...

45

antgroup/glake

GLake: optimizing GPU memory management and IO transmission.

42

Explore LLM Tools

All categories Trending LLM Tool directory Insights