burcgokden/PLDR-LLM-with-KVG-cache

Implementation of PLDR-LLM with KV-cache and G-cache in Pytorch for the paper titled "PLDR-LLMs Learn A Generalizable Tensor Operator That Can Replace Its Own Deep Neural Net At Inference"

17
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 1 / 25
Maturity 16 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Python

License

Apache-2.0

Category

llm-compression-optimization

Last pushed

Mar 19, 2025

Commits (30d)

0

GitHub
Llm Compression Optimization · 44 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/burcgokden/PLDR-LLM-with-KVG-cache"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

ModelTC/LightCompress

[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs,...

64

p-e-w/heretic

Fully automatic censorship removal for language models

62

Orion-zhen/abliteration

Make abliterated models with transformers, easy and fast

54

YerbaPage/LongCodeZip

LongCodeZip: Compress Long Context for Code Language Models [ASE2025]

54

locuslab/wanda

A simple and effective LLM pruning approach.

47

Explore Transformer Models

All categories Trending Transformer directory Insights