airllm and Recurrent-LLM

These are complements: AirLLM enables efficient inference of large models on limited hardware, while Recurrent-LLM provides a specialized architecture for long-form text generation, and using them together would allow resource-constrained systems to generate extended content through recurrent token generation.

airllm
83
Verified
Recurrent-LLM
47
Emerging
Maintenance 16/25
Adoption 22/25
Maturity 25/25
Community 20/25
Maintenance 0/25
Adoption 10/25
Maturity 16/25
Community 21/25
Stars: 13,828
Forks: 1,368
Downloads: 14,143
Commits (30d): 1
Language: Jupyter Notebook
License: Apache-2.0
Stars: 203
Forks: 43
Downloads:
Commits (30d): 0
Language: Python
License: MIT
No risk flags
Stale 6m No Package No Dependents

About airllm

lyogavin/airllm

AirLLM 70B inference with single 4GB GPU

About Recurrent-LLM

jackaduma/Recurrent-LLM

The open-source LLM implementation of paper: RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text. AI 写小说,AI写作

Scores updated daily from GitHub, PyPI, and npm data. How scores work