gateway and casbin-gateway
These two tools are complements in the LLM API gateway ecosystem: Portkey provides the core routing and guardrail functionality for various LLMs, while Casbin Gateway offers an additional layer of fine-grained access control and security for APIs, which can be integrated with Portkey's gateway to enhance overall security.
About gateway
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Supports multi-modal requests (vision, audio, image models), automatic retries with fallback routing, load balancing, and conditional request routing. Built as a lightweight Node.js application (<1ms latency, 122kb footprint) compatible with OpenAI SDKs and frameworks like LangChain, LlamaIndex, and CrewAI. Includes declarative config-based guardrails for output validation and offers enterprise deployments across AWS, Azure, GCP, and Kubernetes environments.
About casbin-gateway
apache/casbin-gateway
Casbin AI & MCP security gateway for HTTP, online demo: https://door.caswaf.com
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work