litellm and openai-forward
These are **competitors** — both provide API gateway/proxy functionality to standardize access to multiple LLM providers, though LiteLLM offers significantly more features (cost tracking, guardrails, load balancing) while openai-forward focuses on lightweight reverse proxying.
About litellm
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Supports A2A agent protocols (LangGraph, Vertex AI, Bedrock, Pydantic AI) and MCP tool servers, allowing seamless integration of agentic workflows and tool ecosystems into any LLM. Implements a unified request/response format across all providers, automatically translating native API schemas to OpenAI-compatible endpoints for interoperability. Available as both a Python SDK and stateless proxy server that can be deployed independently or containerized as a central gateway for multi-tenant LLM access.
About openai-forward
KenyonY/openai-forward
🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work