soumendrak/ragwatch
An SDK for Python AI Agents. Under heavy development.
Computes semantic quality scores (chunk relevance via cosine similarity) directly in RAG traces without LLM calls, integrating with OpenTelemetry for observability. Provides framework-specific adapters for LangGraph and CrewAI via decorators (`@node`, `@workflow`, `@tool`) that automatically extract structured telemetry—tool calls, routing decisions, query rewrites—without modifying business logic. Built on OpenInference span kinds and supports custom attribute policies for truncation and redaction.
Available on PyPI.
Stars
5
Forks
—
Language
Python
License
MIT
Category
Last pushed
Mar 14, 2026
Monthly downloads
804
Commits (30d)
0
Dependencies
3
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/soumendrak/ragwatch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
petterjuan/agentic-reliability-framework
ARF is an agentic reliability intelligence platform that separates decision intelligence (OSS)...
sarkar-ai-taken/riva
Local-first observability and control plane for AI agents.
Nubaeon/empirica
Make AI agents and AI workflows measurably reliable. Epistemic measurement, Noetic RAG,...
relai-ai/relai-sdk
A platform for building reliable AI agents
kalibr-ai/kalibr-sdk-python
Your agents silently degrade in production. Kalibr keeps them on the optimal path — scoring...