teremterem/litellm-server-boilerplate

A lightweight LiteLLM server boilerplate pre-configured with uv and Docker for hosting your own OpenAI- and Anthropic-compatible endpoints. Includes LibreChat as an optional web UI.

32
/ 100
Emerging
No Package No Dependents
Maintenance 6 / 25
Adoption 5 / 25
Maturity 9 / 25
Community 12 / 25

How are scores calculated?

Stars

11

Forks

2

Language

Python

License

MIT

Category

llm-docker-deployments

Last pushed

Dec 08, 2025

Commits (30d)

0

GitHub
LLM Docker Deployments · 150 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/teremterem/litellm-server-boilerplate"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from...

82

av/harbor

One command brings a complete pre-wired LLM stack with hundreds of services to explore.

69

RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

65

runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

64

vtuber-plan/olah

Self-hosted huggingface mirror service. 自建huggingface镜像服务。

63

Explore LLM Tools

All categories Trending LLM Tool directory Insights