maximhq/bifrost

Built in Go with a modular plugin architecture, Bifrost offers semantic caching to reduce latency and costs through intelligent response deduplication, plus Model Context Protocol (MCP) support enabling AI models to invoke external tools and APIs. The gateway provides multi-layered governance—hierarchical budget controls, rate limiting, and access control via virtual keys—alongside comprehensive observability through native Prometheus metrics and distributed tracing. It integrates with HashiCorp Vault for secure credential management and supports SSO authentication, making it suitable for enterprise environments requiring strict security and auditability controls.

2,853 stars. Actively maintained with 419 commits in the last 30 days.