LLM API Gateways LLM Tools

Gateway and proxy solutions that route requests across multiple LLM providers with features like load balancing, cost tracking, authentication, and failover. Does NOT include SDK wrappers, client libraries, or application-level orchestration frameworks.

There are 217 llm api gateways tools tracked. 3 score above 70 (verified tier). The highest-rated is BerriAI/litellm at 98/100 with 38,910 stars and 95,199,449 monthly downloads. 8 of the top 10 are actively maintained.

Get all 217 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-api-gateways&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	BerriAI/litellm Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or...	98	Verified	38,910	Python
2	vava-nessa/free-coding-models Find, benchmark and install in CLI 158 FREE coding LLM models across 20...	79	Verified	547	JavaScript
3	Portkey-AI/gateway A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs,...	77	Verified	10,885	TypeScript
4	coaidev/coai 🚀 Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing...	64	Established	9,008	TypeScript
5	theopenco/llmgateway Route, manage, and analyze your LLM requests across multiple providers with...	64	Established	948	TypeScript
6	envoyproxy/ai-gateway Manages Unified Access to Generative AI Services built on Envoy Gateway	63	Established	1,428	Go
7	intentee/paddler Open-source LLM load balancer and serving platform for self-hosting LLMs at...	60	Established	1,478	Rust
8	jason5ng32/MyIP The best IP Toolbox. Easy to check what's your IPs, IP geolocation, check...	59	Established	9,940	Vue
9	KenyonY/openai-forward 🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · ...	59	Established	988	Python
10	AIGNE-io/aigne-hub AIGNE Hub is the default multi-provider LLM/GPT adapter and API key usage...	57	Established	180	TypeScript
11	Nayjest/lm-proxy OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference...	56	Established	92	Python
12	yonggekkk/x-ui-yg x-ui精简修改版脚本，支持最新的Xhttp传输协议、ENC加密、MLDSA65加密，集成argo固定临时双隧道（可共存）、Psiphon赛风VPN（30...	56	Established	3,577	Shell
13	gitcommitshow/resilient-llm Resilient multi-LLM orchestration with in-built failure handing, rate...	54	Established	30	JavaScript
14	lightseekorg/smg Shepherd Model Gateway	54	Established	89	Rust
15	LianjiaTech/bella-openapi Bella...	53	Established	209	Java
16	KochC/opencode-llm-proxy Local AI gateway for OpenCode — use any model via OpenAI, Anthropic, or Gemini API	52	Established	2	JavaScript
17	Mirrowel/LLM-API-Key-Proxy Universal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible...	51	Established	418	Python
18	mksshare/mksshare.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	50	Established	1,343	—
19	yonggekkk/warp-yg warp多功能一键脚本，支持warp-go与wgcf切换，无限生成warp配置文件，支持升级warp+、warp团队账户，查看VPS本地IP、netfli...	49	Emerging	4,412	Shell
20	aqstack/mimir mimir is a drop-in proxy that caches LLM API responses using semantic...	49	Emerging	150	Go
21	abshare/abshare.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	49	Emerging	914	—
22	apache/casbin-gateway Casbin AI & MCP security gateway for HTTP, online demo: https://door.caswaf.com	49	Emerging	555	Go
23	inference-gateway/inference-gateway An open-source, cloud-native, high-performance gateway unifying multiple LLM...	48	Emerging	104	Go
24	traceloop/hub High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included	48	Emerging	172	Rust
25	etalab-ia/OpenGateLLM An open-source, unified interface for running and managing self-hosted LLMs.	48	Emerging	142	Python
26	jina-ai/reader Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/	47	Emerging	10,191	TypeScript
27	dongyubin/Free-AppleId-Serve 2026年3月更新🚀苹果美区账号 APPLE ID🚀免费共享Shadowrocket（小火箭）账号,Quantumult...	46	Emerging	2,713	Python
28	LeenHawk/gproxy gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude...	46	Emerging	39	Rust
29	zhaoweih/Shadowsocks-Tutorial 🐱给小白的Shadowsocks翻墙教程-Easy-to-follow tutorials for beginners on using...	46	Emerging	2,481	Shell
30	traceloop/go-openllmetry Sister project to OpenLLMetry, but in Go. Open-source observability for your...	44	Emerging	41	Go
31	TU-Wien-dataLAB/aqueduct Aqueduct is a simple yet fully-featured AI gateway built on top of the...	43	Emerging	18	Python
32	doublewordai/control-layer The world’s fastest AI model gateway (450x less overhead than LiteLLM)....	43	Emerging	53	Rust
33	ferro-labs/ai-gateway Open-source AI Gateway written in Go, one API for OpenAI, Anthropic,...	43	Emerging	19	Go
34	DanOps-1/Xray-VPN-OneClick 🚀 5分钟部署 VLESS+Reality VPN \| 访问 ChatGPT/Claude/Google \| npm CLI 管理工具 \|...	43	Emerging	99	TypeScript
35	AprilNEA/BYOKEY Turn AI subscriptions into standard API endpoints. OpenAI & Anthropic...	43	Emerging	12	Rust
36	mlibre/Unified-AI-Router 🚀 Production-ready OpenAI-compatible API server with automatic...	42	Emerging	4	JavaScript
37	Cyclenerd/google-cloud-litellm-proxy 🚅 LiteLLM Proxy for Google Cloud Generative AI	41	Emerging	61	Dockerfile
38	KenyonY/flexllm High-Performance LLM Client for Production Batch processing with checkpoint...	41	Emerging	2	Python
39	prince776/LLM-Tor A Privacy Layer For Using Frontier LLMs Anonymously	41	Emerging	10	TypeScript
40	linto-ai/llm-gateway LLM service gateway: define once, call anywhere. Handles chunking, queuing,...	41	Emerging	12	Python
41	ENTERPILOT/GOModel High-performance AI gateway written in Go - unified OpenAI-compatible API...	40	Emerging	20	Go
42	AI-Stats/AI-Stats Open-source, OpenAI-compatible AI gateway with health-aware routing,...	40	Emerging	5	TypeScript
43	tprc1949/cheap-vpn-airport 🚁🚀 2025便宜机场推荐 \| 全网最便宜机场！cheapvpn，快连VPN...	40	Emerging	230	HTML
44	Helicone/ai-gateway The fastest, lightest, and easiest-to-integrate AI gateway on the market....	40	Emerging	549	Rust
45	greynewell/infermux Route inference across LLM providers. Track cost per request.	38	Emerging	89	Go
46	Tanantor/langgate Lightweight AI inference gateway - local model registry & parameter...	38	Emerging	6	Python
47	saivedant169/AegisFlow Open-Source AI Gateway + Policy + Observability Control Plane. Route,...	38	Emerging	3	Go
48	ultrasev/llmproxy-vercel 通过 vercel 搭建 LLM API 的反向代理	38	Emerging	52	Python
49	omnidotdev/synapse-gateway 🧠 Orchestrated intelligence (Synapse gateway)	37	Emerging	3	Rust
50	ekaone/llm-gate A lightweight state-machine that tracks token counts, prevents "Denial of...	37	Emerging	1	TypeScript
51	bricks-cloud/BricksLLM 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or...	37	Emerging	1,173	Go
52	EinStack/glide 🐦 A open blazing-fast simple model gateway for rapid development of...	37	Emerging	158	Go
53	lynxai-team/goinfer Local LLM proxy, DevOps friendly	37	Emerging	9	Go
54	voidmind-io/voidllm Privacy-first LLM proxy and AI gateway — load balancing, multi-provider...	37	Emerging	16	Go
55	yonggekkk/Replit-Xray Replit容器部署xray代理，支持argo固定隧道与临时隧道，自定义伪装网页，一键五协议共存，支持搭建vless、vmess、trojan、shado...	36	Emerging	879	—
56	liangshengyong/LanWan 蓝湾是一个 L2TP/IPsec 服务器测试程序，完全开源永久免费无限流量自带节点无需订阅高速稳定科学上网翻墙梯子VPN软件	36	Emerging	19	C
57	Aaryan-Kapoor/ModelGate-Hackathon 🏆Winning Project \| ModelGate is a contract-aware AI control plane that...	36	Emerging	2	TypeScript
58	pborenstein/apantli Lightweight local LLM proxy with SQLite cost tracking & interactive model...	35	Emerging	4	JavaScript
59	0M3REXE/eidolon Eidolon is a high-performance reverse proxy designed to secure Large...	35	Emerging	5	Rust
60	andreimerfu/pllm High-performance LLM Gateway built in Go - OpenAI compatible proxy with...	34	Emerging	14	Go
61	Writesonic/GPTRouter Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models...	34	Emerging	456	TypeScript
62	spoonnotfound/apiflow Modern, Open-Source API Gateway & Proxy For AI Services	33	Emerging	20	TypeScript
63	usagepanda/proxy Security and compliance proxy for LLM APIs	33	Emerging	51	JavaScript
64	uni-token/core LLM Token Solution for Local AI Agents	33	Emerging	7	Vue
65	ottic-ai/llm-gateway Open-source library built for fast and reliable connections to different...	33	Emerging	7	TypeScript
66	mkshare3/mkshare3.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	33	Emerging	208	—
67	missingstudio/gateway [deprecated] AI Gateway - core infrastructure stack for building...	33	Emerging	160	Go
68	matdev83/llm-interactive-proxy Connect any LLM-powered client app, such as a coding agent, to any supported...	33	Emerging	15	Python
69	Kelpejol/llm-output-stability-gate Pre-execution reliability gate using UQLM for LLM output stability	32	Emerging	9	Python
70	obirler/LLMProxy LLMProxy is an intelligent large language model backend routing proxy service.	32	Emerging	22	C#
71	toshare5/toshare5.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	30	Emerging	185	—
72	fly-apps/bumblebee-model-harness Minimal Elixir application that can host AI models on Fly.io GPUs and make...	30	Emerging	52	Elixir
73	ihuzaifashoukat/free-ai-router 150+ free AI models across 20+ providers. Groq, Cerebras, NVIDIA and more...	29	Experimental	1	TypeScript
74	bold84/cot_proxy Smart proxy for LLM APIs that enables model-specific parameter control,...	29	Experimental	51	Python
75	tcsenpai/keyfleur API Keys made beautiful	29	Experimental	68	Python
76	SAILFISH-PTE-LTD/MetroVPN-Windows Fastest VPN for Streaming,Gaming \| ChatGPT Netflix Disney Hulu Hotstar PUBG	29	Experimental	3	—
77	adsorgcn/vpscheck 🛡️...	28	Experimental	5	Shell
78	newnameformat/custom-proxy-for-janitorai A * very * simple guide to using Deepseek or any other models on Janitor.ai	28	Experimental	6	CSS
79	star5o/reverse-check Pure Front-End LLM API Testing Tool	28	Experimental	79	Vue
80	8monkey-ai/hebo-gateway AI Gateway as a Framework. Full control over models, routing & lifecycle....	28	Experimental	17	TypeScript
81	jichangbaike/ikuuu iKUUU 官网地址入口与多平台使用指南，包含价格、优惠码和常见问题	27	Experimental	5	—
82	abshare3/abshare3.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	27	Experimental	205	—
83	DatanoiseTV/aigateway Self-hosted AI API gateway with per-client provider config (Gemini, OpenAI,...	27	Experimental	5	Go
84	COO-LLM/coo-llm-main A high-performance reverse proxy that intelligently distributes requests...	27	Experimental	8	Go
85	vpngpt/vpngpt.github.io 免费VPN，GPT必要神器，支持V2Ray、vpn、免费机场、无限流量，免费VPN，无限流量！V2Ray节点分享，支持v2ray，clash，小火箭！vp...	27	Experimental	1	HTML
86	PropsAI/proxy Props AI provides this open source proxy for Open AI that allows you to...	26	Experimental	11	Go
87	smxl/500 Quantumult X, Loon, Stash 预配置文件: Apple News 解锁, 去广告, 分流规则, Bing AI, TikTok...	26	Experimental	387	JavaScript
88	tprc1949/cheap-vpn-recommendation 🚁🚀 2025机场推荐 \| 全网最便宜机场！cheapvpn，快连VPN...	26	Experimental	82	—
89	Azranus/justmysocks 🔥Just My Socks 🔥2025最新翻墙梯子教程（支持ChatGPT）科学上网	26	Experimental	55	—
90	garyblankenship/wormhole High-performance, multi-provider LLM SDK for Go. Unified access to OpenAI,...	26	Experimental	5	Go
91	Jaax-Labs/nimbus-router Nimbus is a zero-dependency local proxy that routes your IDE's AI requests...	26	Experimental	6	TypeScript
92	gabotechs/signway Bring the power of pre-signed URLs to your apps. Signway is a gateway for...	26	Experimental	99	Rust
93	B022MC/b022hub Self-hosted AI API gateway fork based on Sub2API, focused on subscription...	26	Experimental	—	Go
94	Cisco-AIXEdge/Cisco-AIXEdge Edge AI on Cisco IOS XE	26	Experimental	4	Go
95	azerozero/grob High-performance LLM routing proxy — multi-provider failover, DLP/secret...	25	Experimental	4	Rust
96	tamntlib/LiteLLM-X-Server-Config A self-hosted LLM proxy service combining LiteLLM and CLIProxyAPI to enable...	25	Experimental	3	Python
97	Temikus/butter A blazingly fast AI proxy gateway.	25	Experimental	3	Go
98	nazdridoy/llm-proxy A robust, transparent REST API proxy service for LLM APIs with profile-based...	25	Experimental	2	JavaScript
99	jmanhype/req_llm_gateway OpenAI-compatible LLM proxy with telemetry and multi-provider routing	25	Experimental	3	Elixir
100	hyperpolymath/conative-gating SLM-as-Cerebellum for LLM Policy Enforcement - biologically-inspired GO/NO-GO gating	24	Experimental	2	Rust
101	crabtalk/crabllm Litellm inspired LLM gateway with cost tracking, guardrails, load balancing...	24	Experimental	2	Rust
102	systemime/coding-plan-mask 🎭 Mask your Coding Plan API for any AI coding tool - OpenAI-compatible proxy...	24	Experimental	2	Go
103	vpontual/llm-traffic-manager A dashboard and proxy server for monitoring and managing a fleet of LLM...	24	Experimental	2	TypeScript
104	accuknox/bifrost-accuknox-integration AccuKnox integration with Bifrost LLM gateway	24	Experimental	1	Go
105	inferret/infer A declarative DSL (domain-specific language) for IDD...	24	Experimental	3	Go
106	stewartpark/private-llm 🔒 Your own private LLM provider with enterprise-grade privacy	24	Experimental	2	Go
107	nickna/Conduit A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints	23	Experimental	8	C#
108	thecelestialmismatch/Kaelus.ai Real-time AI Compliance Gateway — Cloudflare for AI traffic. Multi-provider...	23	Experimental	1	TypeScript
109	myfinder/AIKeyHive Unified LLM API key management platform	23	Experimental	1	TypeScript
110	scottxxxxx/cloudzap Open-source LLM API gateway with auth, multi-provider routing, and...	23	Experimental	1	Python
111	bigint/raven Unified AI gateway for routing, managing, and monitoring LLM API traffic	23	Experimental	1	TypeScript
112	maxrihter/imago-LLM-marketplace AI Inference Gateway native to TON/Telegram: OpenAI-compatible API, TON...	23	Experimental	1	TypeScript
113	mcp-tool-shop-org/LeaseGate-Lite A one-tab MAUI control surface and local daemon for throttling AI workloads...	23	Experimental	1	C#
114	hkdb/lmgate A high performance authentication and access-control gateway for LLM API backends	23	Experimental	1	Go
115	ideo-mind/oh-my-ai Bun-native LLM proxy runner with automatic key rotation and a live admin panel.	23	Experimental	1	HTML
116	ElliotOne/nl-production-reliability-engineering-ai-apis Deterministic inference gateway for local LLMs with production-grade...	23	Experimental	1	C#
117	flexigpt/inference-go A single interface in Go to get inference from multiple llm/ai providers...	23	Experimental	1	Go
118	rickcrawford/tokenomics An OpenAI-compatible reverse proxy you run yourself. It gives you the...	23	Experimental	1	Go
119	fabriziosalmi/llmproxy Security-first proxy for Large Language Models	23	Experimental	1	Python
120	thecelestialmismatch/Kaelus.Online Real-time AI Compliance Gateway — Cloudflare for AI traffic. Multi-provider...	23	Experimental	1	TypeScript
121	Strato-Ai/Spectre-ai-inference-loadbalancer NGINX-based load balancer for compute offload to multiple AI backends with...	23	Experimental	1	HTML
122	robbyt/llm_proxy AI aware proxy	23	Experimental	19	Go
123	dellarwalter/ThrottleAI 🚀 Manage API request rates efficiently with ThrottleAI to prevent overload...	22	Experimental	—	TypeScript
124	hiothere/reflexio 🔄 Implement flexible retry policies with pluggable classification and...	22	Experimental	—	Python
125	sserada/llm-glass Chrome DevTools for LLM API calls. A local proxy that displays all LLM...	22	Experimental	—	Python
126	vcal-project/ai-firewall OpenAI-compatible LLM gateway that reduces API costs using Redis exact cache...	22	Experimental	—	Rust
127	adwantg/kvfleet KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets....	22	Experimental	—	Python
128	jichangzhu/Dageyun 大哥云官网地址	22	Experimental	36	—
129	Yibeichouxu/ai-gateway 🚀 一个端点，连接所有 AI 模型。OpenAI 兼容 API Gateway，支持 Claude、Gemini、GPT、DeepSeek 等 50+...	22	Experimental	—	TypeScript
130	ScriptSmith/hadrian Open-source AI Gateway, all enterprise features included	22	Experimental	—	Rust
131	lipish/xgateway Xgateway Link is a universal LLM proxy service providing seamless access to...	22	Experimental	—	Rust
132	yagna-1/nexusgate Intelligent multi-provider LLM gateway with cost governance, rate limit...	22	Experimental	—	Rust
133	teilomillet/hapax The reliability layer between your code and LLM providers.	22	Experimental	23	Go
134	Alorse/llm-proxy Allows any BYOK AI editor or extension, such as Cursor or Continue, to...	22	Experimental	18	TypeScript
135	mrexodia/logging-proxy High performance reverse proxy for logging LLM traces (OpenRouter/LiteLLM)	22	Experimental	4	Go
136	PanJung99/pan-api (开发中) 基于 Java 的高性能多模型调度网关：统一标准接口，旨在集成国内外主流 LLM，支持多 Key 调度、计费与监控。	22	Experimental	3	Java
137	LachlanM05/neural-gateway Two-Part system for routing requests from the internet to a user's local hardware.	22	Experimental	—	JavaScript
138	AsiaOstrich/llm-key-router Lightweight Node.js reverse proxy for managing LLM API key pools with...	22	Experimental	—	JavaScript
139	tamaproject360/pabriktokenx Enterprise-grade OAuth proxy server for AI coding platforms with...	22	Experimental	—	Go
140	natelindev/llm-gateway Production-minded multi-model LLM inference gateway in Go with SSE...	22	Experimental	—	Go
141	distira-project/distira DISTIRA — Sovereign AI Context Operating System, reduces token waste before...	22	Experimental	—	Rust
142	Luetzen/ai-gateway Provider-agnostic AI gateway for Rust — LM Studio, Anthropic Claude, Google...	22	Experimental	—	Rust
143	nvsudo/opengates Source-available runtime for filtering inbound through conversation.	22	Experimental	—	Python
144	fazer-ai/langfuse-proxy Lightweight Bun + Elysia proxy for OpenAI-compatible APIs with Langfuse telemetry	22	Experimental	—	TypeScript
145	chziyue/savor LLM Proxy Gateway for OpenClaw	22	Experimental	—	TypeScript
146	gacabartosz/gaca-core Universal AI Bus — 50+ free LLM models from 11 providers with automatic...	22	Experimental	—	TypeScript
147	Maas-Cloud-API/maas-cloud-api Multi-tenant LLM API Management Platform \| Higress + Go + Next.js \| 40+...	22	Experimental	—	TypeScript
148	lu-zhengda/liteoauthllm A lightweight local AI gateway proxy that uses ChatGPT or Claude...	22	Experimental	—	Go
149	hra42/tenantai A minimal, production-ready AI API proxy in Go with per-tenant database...	22	Experimental	—	Go
150	nunoferna/aegis-llm LLMOps API Gateway in Go. Optimizes GenAI workloads with Qdrant semantic...	22	Experimental	—	Go
151	stockyard-dev/Stockyard Self-hosted LLM proxy and control plane. 58 middleware modules, 16...	22	Experimental	—	HTML
152	kawaiirashi/llm-retry Provide retry logic and circuit breaker functionality for C++ applications...	22	Experimental	—	C++
153	kszongic/llm-api-proxy Lightweight proxy server for LLM APIs with rate limiting and key rotation.	22	Experimental	—	TypeScript
154	michaelkrauty/llamesh OpenAI-compatible mesh proxy for llama.cpp	22	Experimental	—	Rust
155	Wolk-Inc/wolk-ai-gateway LLM API gateway with cost tracking, routing, guardrails, and provider abstraction.	22	Experimental	—	TypeScript
156	mcp-tool-shop-org/ThrottleAI A token-based lease governor for AI calls — small enough to embed anywhere,...	22	Experimental	—	TypeScript
157	zorrofox/llm-apigee Enterprise LLM API gateway on Apigee X: 30+ models (Gemini, Claude, GLM,...	22	Experimental	—	TypeScript
158	kzxl/aiproxy_gateway A blazing fast API Gateway Proxy for Local LLMs & OpenAI that caches prompts...	22	Experimental	—	Go
159	mrostamii/tooti Decentralized AI inference protocol; coordination, routing, and (later)...	22	Experimental	—	Go
160	provnai/provnzero A high-performance Zero Data Retention (ZDR) proxy for AI APIs. Zero...	22	Experimental	—	Rust
161	mlycore/log A high-performance Golang log choice for human.	22	Experimental	1	Go
162	modpotatodotdev/LLMG an llm provider gateway in rust, fully rig compatible	21	Experimental	2	Rust
163	eugener/gandalf Lightweight LLM gateway with multi-provider failover, streaming, and native...	21	Experimental	2	Go
164	JawherKl/llm-api-gateway Scalable API gateway that aggregates calls to multiple LLMs (OpenAI, Hugging...	21	Experimental	18	Go
165	lennyerik/crawl4ai-proxy A simple proxy server to integrate crawl4ai with OpenWebUI	21	Experimental	19	Go
166	randomvariable/rocm-llamacpp-envoy-ai-gateway-external-processor For routing requests in an AMD based Kubernetes cluster	20	Experimental	1	Go
167	carmel/gomlx High-Performance AI Model Serving Gateway	20	Experimental	1	Go
168	Xuuuuu04/new-api new-api 社区精简版（非官方），聚焦核心网关能力与可维护性。	20	Experimental	1	Go
169	inference-gateway/operator This project provides a Kubernetes Operator for managing the lifecycle of...	20	Experimental	1	Go
170	EeroEternal/unigateway Scenario-oriented LLM gateway with OpenAI and Anthropic compatibility.	20	Experimental	1	Rust
171	mfinikov/llm-gateway Example of LLM Gateway for high load systems	20	Experimental	1	Go
172	kacf/LLM-Gateway ⚡ LLM Gateway is a zero-config local AI gateway. Run any GGUF model on your...	20	Experimental	1	Go
173	gorusys/llm-stream-gateway Production Go HTTP service: OpenAI-compatible chat completions with SSE,...	19	Experimental	—	Go
174	RealnodeVpn/freevpn_freev2ray 🚀免费节点,🚀免费节点订阅,🚀v2ray免费节点,ssr免费节点订阅,clash免费节点订阅,免费梯子,免费翻墙,免费科学上网,免费ss/v2ray/tr...	19	Experimental	90	—
175	SAitharaju/aura-ai-gateway 🛡️ Blazing-fast observability and budget-tracking proxy for LLMs. Sub-10ms...	19	Experimental	—	Go
176	mrmushfiq/llm0-gateway-starter LLM gateway starter from LLM0.ai	19	Experimental	—	Go
177	AaronStardust/tizi 天路云，付费翻墙梯子（即VPN），无流量限制，GPT可用，全平台支持（Android / iOS / Windows / MacOS / Linux /...	18	Experimental	153	—
178	VonSdite/LLM_Proxy ONE API，LLM_Proxy，统一代理，支持请求响应自定义转换。	17	Experimental	4	Python
179	jiedian123com/totorocloud 龙猫云机场评测与最新官网地址	17	Experimental	2	—
180	modelgw/examples Model Gateway examples - The fastest OpenAI GPT API	16	Experimental	3	Java
181	serle/igentai Distributed system for orchestrating multiple LLM providers with real-time...	16	Experimental	1	Rust
182	felafax/felafax-gateway felafax-gateway is a fast and lightweight proxy for LLMs, written in Rust....	16	Experimental	3	Rust
183	cymoo/llm-gateway An LLM gateway	16	Experimental	2	TypeScript
184	modelgw/modelgw Gateway and load balancer to your LLM inference endpoints	15	Experimental	26	TypeScript
185	xiaoxu123195/GrokToAPI 🚀 Grok AI 的高性能 OpenAI 兼容网关 \| 企业级令牌管理 \| 媒体缓存 \| Go 构建	15	Experimental	—	Go
186	WangYihang/LLM-Redactor A transparent egress gateway to redact sensitive credentials and local data...	15	Experimental	1	Go
187	TOMIBABY/freevpn 🌐 Access the internet freely and securely with our versatile VPN, supporting...	15	Experimental	1	—
188	lipish/unigateway A lightweight, high-performance LLM gateway written in Rust. Features OpenAI...	15	Experimental	1	Rust
189	llmsocket/gateway Blazing-fast AI gateway in Go. Sub-millisecond overhead. Zero external...	15	Experimental	1	Go
190	specful-ai/sfgateway API gateway and reverse proxy for OpenAI APIs	15	Experimental	15	Go
191	vendetta-osint/the-door-stays-open AI coalition infrastructure for cross-architecture communication....	15	Experimental	—	—
192	evgensoft/ai-proxy Proxy for many LLM-provider with OpenAI like request	15	Experimental	5	Go
193	jichangbaike/xxfeng 小旋风 (xxfeng) 官网地址入口说明与多平台使用指南，包含套餐详情及订阅导入指引。	14	Experimental	—	—
194	charmitro/ai-proxy A lightweight proxy for LLM API calls with guardrails, metrics, and...	14	Experimental	3	Go
195	hrp749492216/llmgateway A lightweight web UI for sending prompts to OpenAI, Claude, Gemini, and...	14	Experimental	—	JavaScript
196	amin-tehrani/llm-gate The Control Plane for your LLM API Keys. Manage 30+ providers with one CLI.	14	Experimental	—	Go
197	marouchsail/aigateway Manage and route API requests between applications and multiple LLM...	14	Experimental	—	Go
198	jichangzhu/TotoroCloud 龙猫云机场官网地址	14	Experimental	47	—
199	CJianYu/justmysocks Just My Socks科学上网教程	14	Experimental	7	—
200	scuton-technology/llm-gateway Universal LLM proxy — single OpenAI-compatible API for 12 providers with SSE...	14	Experimental	—	Go
201	gpu-bridge/gpu-bridge 26 AI services. One endpoint. POST /run and you are done.	14	Experimental	—	—
202	Xrey995/ai-rapi OpenAI-Compatible API Gateway — 48 models, unlimited tokens, fixed price	14	Experimental	—	—
203	cp50/ai-gateway AI inference gateway with intelligent LLM routing, multi-tenant access...	14	Experimental	—	JavaScript
204	Qually5/go-inference-proxy A lightweight, high-concurrency proxy for managing multiple AI model endpoints.	14	Experimental	—	Go
205	dinahthreewheel75/Air.rs Enable fast GPU inference of large language models that exceed GPU memory by...	14	Experimental	—	Rust
206	habibi-dev/rust-llm-proxy A fast Rust-based gateway unifying access to multiple LLM providers with...	14	Experimental	3	Rust
207	oxtx/hapax The reliability layer between your code and LLM providers. Hapax is a...	13	Experimental	2	Go
208	nstankov-bg/oaievals-collector The OAIEvals Collector: A robust, Go-based metric collector for EVALS data....	12	Experimental	3	Go
209	DDDDDevin/manus-llm-api-gateway 提供一个统一的、可扩展的中间层,用于管理和调用各种大型语言模型(LLM)的API。通过简单的配置,您可以轻松地集成和切换不同的模型提供商,如OpenAI、...	12	Experimental	1	Java
210	thalesfsp/inference Provides building blocks to integrate with AI / LLM providers and built-in,...	11	Experimental	—	Go
211	almaz-go/llm-audit-gateway A high-performance Go-based proxy for monitoring, auditing, and securing LLM...	11	Experimental	—	Go
212	uuvosd/Free-AppleId 🚀免费Shadowrocket账号，小火箭节点，🚀 免费订阅地址，🚀 免费节点，🚀...	11	Experimental	2	—
213	cyberorg/meshtastic2skylines Forward position to skylines to live track your flying machine on skylines,...	11	Experimental	2	—
214	landry-some/mimir mimir is a drop-in proxy that caches LLM API responses using semantic...	11	Experimental	—	Go
215	agoft/neuralbridge.ru Единый OpenAI-совместимый API для доступа к 70+ AI-моделям. Llama, Flux,...	11	Experimental	—	—
216	mkrueger12/Glide A Rusty LLM Router	10	Experimental	1	Rust
217	jichangzhu/FatcatCloud 肥猫云机场官网地址	10	Experimental	38	—

Comparisons in this category

litellm and openai-forward (98 vs 59) litellm and llmgateway (98 vs 64) litellm and LLM-API-Key-Proxy (98 vs 51) litellm and lm-proxy (98 vs 56) litellm and opencode-llm-proxy (98 vs 52) gateway and coai (77 vs 64) gateway and ai-gateway (77 vs 63) gateway and llmgateway (77 vs 64) gateway and casbin-gateway (77 vs 49) gateway and lm-proxy (77 vs 56)