comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Opik provides native integrations with major LLM frameworks (LangChain, LlamaIndex, Anthropic SDK, Google ADK, Autogen) and includes built-in LLM-as-a-judge metrics for hallucination detection, moderation, and RAG-specific evaluation without external dependencies. The platform supports both self-hosted and cloud deployment, enabling high-volume production tracing (40M+ traces/day) with online evaluation rules that trigger automated quality checks, complemented by an Agent Optimizer SDK for continuous prompt and tool refinement.
18,211 stars and 3,982,317 monthly downloads. Used by 2 other packages. Actively maintained with 425 commits in the last 30 days. Available on PyPI.
Stars
18,211
Forks
1,392
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 13, 2026
Monthly downloads
3,982,317
Commits (30d)
425
Dependencies
15
Reverse dependents
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/comet-ml/opik"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.