evidentlyai/evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Provides a modular Python framework with composable **Reports** for exploratory analysis and **Test Suites** for automated regression testing, supporting 100+ built-in metrics across tabular, text, and LLM data. Includes row-level **descriptors** (sentiment, toxicity, semantic similarity) and configurable pass/fail conditions, with optional self-hosted or cloud-based monitoring dashboards for tracking metrics over time.
7,298 stars and 1,096,377 monthly downloads. Used by 2 other packages. Actively maintained with 4 commits in the last 30 days. Available on PyPI.
Stars
7,298
Forks
805
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Mar 10, 2026
Monthly downloads
1,096,377
Commits (30d)
4
Dependencies
26
Reverse dependents
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/evidentlyai/evidently"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
openlit/openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring,...
deepflowio/deepflow
eBPF Observability - Distributed Tracing and Profiling
myscale/myscale-telemetry
Open-source observability for your LLM application.
psalias2006/gpu-hot
🔥 Real-time NVIDIA GPU dashboard
apache/hertzbeat-helm-chart
An AI-powered next-generation open source real-time observability system.