AstrolexisAI/MnemoCUDA

Expert streaming inference engine for MoE models larger than VRAM — run 235B+ models on consumer GPUs

/ 100

Experimental

No Package No Dependents

Maintenance 13 / 25

Adoption 0 / 25

Maturity 9 / 25

Community 0 / 25

Stars

—

Forks

—

Language

License

AGPL-3.0

Category

Last pushed

Mar 25, 2026

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/AstrolexisAI/MnemoCUDA"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

windreamer/flash-attention3-wheels

Pre-built wheels that erase Flash Attention 3 installation headaches.

wesleyscholl/drex

🦀 The transformer is a brilliant hack scaled past its limits. DREX is what comes next — tiered...

kamalrss88/FlashMLA

🚀 Accelerate attention mechanisms with FlashMLA, featuring optimized kernels for DeepSeek...

aymanelrody/FlashMLA

⚡ Optimize attention mechanisms with FlashMLA, a library of advanced sparse and dense kernels...

NAME0x0/OMNI

PERSPECTIVE v2 — A 1.05 trillion parameter sparse Mixture-of-Experts language model that runs on...