Llm Observability Monitoring MLOps Tools

There are 8 llm observability monitoring tools tracked. 3 score above 70 (verified tier). The highest-rated is openlit/openlit at 86/100 with 2,281 stars and 1,164,250 monthly downloads. 3 of the top 10 are actively maintained.

Get all 8 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=llm-observability-monitoring&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 openlit/openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM...

86
Verified
2 evidentlyai/evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate,...

84
Verified
3 deepflowio/deepflow

eBPF Observability - Distributed Tracing and Profiling

72
Verified
4 psalias2006/gpu-hot

πŸ”₯ Real-time NVIDIA GPU dashboard

43
Emerging
5 myscale/myscale-telemetry

Open-source observability for your LLM application.

43
Emerging
6 apache/hertzbeat-helm-chart

An AI-powered next-generation open source real-time observability system.

38
Emerging
7 Herenn/Infralens

InfraLens is a next-generation observability tool that uses eBPF to...

30
Emerging
8 Unicorn-Commander/Ops-Center-OSS

Ops-Center β€” The AI Infrastructure Command Center. Manage users, billing,...

24
Experimental