xllm and ZhiLight

xllm

Verified

ZhiLight

Established

Maintenance 25/25

Adoption 10/25

Maturity 15/25

Community 22/25

Maintenance 20/25

Adoption 10/25

Maturity 16/25

Community 20/25

Stars: 1,081

Forks: 149

Downloads: —

Commits (30d): 136

Language: C++

License: —

Stars: 905

Forks: 102

Downloads: —

Commits (30d): 6

Language: C++

License: Apache-2.0

No Package No Dependents

About xllm

jd-opensource/xllm

A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

zhihu/ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

xllm and vllm xllm and MNN xllm and inference xllm and gpustack xllm and vllm xllm and LightLLM

Scores updated daily from GitHub, PyPI, and npm data. How scores work