LianHe-BI/Blackwell-optimized-llama.cpp-Docker-image

Blackwell-optimized llama.cpp Docker image – works on all NVIDIA GPUs, but tuned for RTX 50 series. Built from scratch with CUDA 12.8, sm_120, NVFP4-ready. 250+ tok/s on 4B F16. Includes llama-chat script.

25
/ 100
Experimental
No Package No Dependents
Maintenance 13 / 25
Adoption 3 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

4

Forks

—

Language

—

License

Apache-2.0

Category

llm-docker-deployments

Last pushed

Mar 28, 2026

Commits (30d)

0

GitHub
LLM Docker Deployments · 150 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/LianHe-BI/Blackwell-optimized-llama.cpp-Docker-image"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from...

82

av/harbor

One command brings a complete pre-wired LLM stack with hundreds of services to explore.

69

RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

65

runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

64

vtuber-plan/olah

Self-hosted huggingface mirror service. 自建huggingface镜像服务。

63

Explore LLM Tools

All categories Trending LLM Tool directory Insights