gateway and ai-gateway
These are competitors offering alternative approaches to LLM routing and access control—Portkey-AI provides a managed gateway service with built-in guardrails, while Envoy's offering leverages the Envoy proxy infrastructure for organizations preferring self-hosted gateway solutions.
About gateway
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Supports multi-modal requests (vision, audio, image models), automatic retries with fallback routing, load balancing, and conditional request routing. Built as a lightweight Node.js application (<1ms latency, 122kb footprint) compatible with OpenAI SDKs and frameworks like LangChain, LlamaIndex, and CrewAI. Includes declarative config-based guardrails for output validation and offers enterprise deployments across AWS, Azure, GCP, and Kubernetes environments.
About ai-gateway
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work