prajeesh-chavan/OpenLLM-Monitor

OpenLLM Monitor is a plug-and-play, real-time observability dashboard for monitoring and debugging LLM API calls across OpenAI, Ollama, OpenRouter, and more. Tracks tokens, latency, cost, retries, and lets you replay prompts — fully open-source and self-hostable.

32
/ 100
Emerging

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 6 / 25
Maturity 9 / 25
Community 15 / 25

How are scores calculated?

Stars

20

Forks

4

Language

JavaScript

License

MIT

Category

llm-observability-monitoring

Last pushed

Jun 26, 2025

Commits (30d)

0

GitHub
LLM Observability & Monitoring · 75 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/prajeesh-chavan/OpenLLM-Monitor"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Arize-ai/openinference

OpenTelemetry Instrumentation for AI Observability

76

vndee/llm-sandbox

Lightweight and portable LLM sandbox runtime (code interpreter) Python library.

75

apache/hertzbeat

An AI-powered next-generation open source real-time observability system.

73

traceloop/openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

71

Scale3-Labs/langtrace-python-sdk

Langtrace SDK for Python Applications

65

Explore LLM Tools

All categories Trending LLM Tool directory Insights