helicone and brokle
These are competitors in the LLM observability space, both offering monitoring, evaluation, and prompt management capabilities, though Helicone is a mature open-source platform while Brokle appears to be an early-stage offering with native OpenTelemetry integration.
About helicone
Helicone/helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Operates as a reverse proxy AI gateway that intercepts requests to 100+ LLM providers through a unified OpenAI-compatible API, enabling intelligent routing and automatic fallbacks. Built on a microservices architecture with a Cloudflare Workers proxy layer for request interception, Express-based collection server (Jawn), ClickHouse for analytics, and Supabase for application data. Integrates with OpenAI, Anthropic, Gemini, LangChain, Vercel AI SDK, and supports self-hosting via Docker or Helm with optional async logging through OpenLLMetry.
About brokle
brokle-ai/brokle
The AI engineering platform for AI teams. Observability, evaluation, and prompt management for LLMs and AI agents. OpenTelemetry native.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work