Agent Monitoring Debugging LLM Tools

Tools for real-time monitoring, tracing, visualization, and debugging of AI agent execution. Includes cost tracking, performance analysis, and decision transparency. Does NOT include general observability platforms, LLM evaluation frameworks, or agent orchestration/build platforms.

There are 56 agent monitoring debugging tools tracked. The highest-rated is aimclub/OSA at 48/100 with 134 stars.

Get all 56 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=agent-monitoring-debugging&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	aimclub/OSA Tool that just makes your open source project better using LLM agents	48	Emerging	134	Python
2	arthur-ai/arthur-engine Make AI work for Everyone - Monitoring and governing for your AI/ML	44	Emerging	69	Python
3	auraguardhq/aura-guard Exactly-once + circuit breaker for agent tool calls (loops, retries,...	42	Emerging	5	Python
4	anthalehq/anthale-node Anthale's official TypeScript SDK	39	Emerging	1	TypeScript
5	typper-io/ai-code-sandbox Secure Python sandbox for AI/ML code execution using Docker. Run LLM outputs safely.	38	Emerging	61	Python
6	GoPlausible/.github Plausible is a proof of anything protocol for Algorand	38	Emerging	3	—
7	Sigmabrogz/agent-devtools Chrome DevTools for AI Agents - Real-time debugging, pause, inspect, and...	37	Emerging	3	Python
8	sagents-ai/sagents_live_debugger A Phoenix LiveView dashboard for debugging and monitoring Sagents agents in...	37	Emerging	18	Elixir
9	anilatambharii/argus-ai The world's first AI observability platform that doesn't just alert you- it...	37	Emerging	3	Python
10	fisheatfish/ai-sandbox A complete Docker sandbox for developers who want to explore and experiment...	37	Emerging	4	Dockerfile
11	rune0-dev/agent-ledger The missing transactional layer for AI agents side effects. At-most-once...	35	Emerging	4	Python
12	samarthaggarwal/always-on-debugger Making terminal debugging 10x faster	33	Emerging	34	Python
13	quentinducasse/decima DECIMA (Data Extraction & Contextual Inference for MCNP Analysis) — MCNP...	33	Emerging	1	C++
14	vijaygopalbalasa/AgentKernel Security sandbox for AI agents — intercepts all actions, enforces policies,...	32	Emerging	1	TypeScript
15	os-for-agent/os-for-agent.github.io AgentOS Workshop for ASPLOS'26	29	Experimental	4	HTML
16	antonpk1/stackfish Stackfish is an open-source LLM-powered pipeline designed to automatically...	27	Experimental	53	C++
17	PovedaAqui/cybertraceai-ops [DEPRECATED] CybertraceAI-Ops is an open-source AI agent designed to...	26	Experimental	4	Python
18	nionis/near-innovation-sandbox Safe, auditable, and private AI for governments.	26	Experimental	3	TypeScript
19	ArkFelix7/agentlens Chrome DevTools for AI Agents — real-time observability, hallucination...	25	Experimental	3	Python
20	vladimir22700/agent-monitor 📊 Monitor AI agents in real-time with Agent Monitor. Gain visibility, track...	24	Experimental	2	Python
21	Nitin-100/agentlens Open-source observability platform for AI agents. Trace every LLM call, tool...	24	Experimental	2	Python
22	AreteDriver/agent-lint CLI tool for cost estimation and anti-pattern detection in agent workflow...	24	Experimental	2	Python
23	CURSED-ME/agent_trace Zero-config visual debugging and auto-evaluation for LLM agents. Local-first...	24	Experimental	2	Python
24	tannernicol/agent-conclave Get a second AI opinion without being human middleware — models debate until...	24	Experimental	2	Python
25	Vitalcheffe/Wrap The AI Kernel for secure, local-first agentic infrastructure. Zero-trust,...	23	Experimental	1	TypeScript
26	vspatabuga/ai-governance-orchestrator Operational Engine for Managing and Auditing Private AI Agents with OpenClaw...	23	Experimental	1	Shell
27	anthalehq/anthale-openapi Anthale's official OpenAPI specification	23	Experimental	1	—
28	Nefza99/Rebis-AI-auditing-Architecture Orchestration runtime for AI agent workflows that preserves task-state...	23	Experimental	1	JavaScript
29	vivekvar-dl/agentscope The missing debugger for AI agents - Track costs, monitor execution, and...	23	Experimental	1	Python
30	anthalehq/anthale-examples Curated examples and secure design templates to help you build robust,...	23	Experimental	1	—
31	anthalehq/anthale-agent-skills Anthale's official AI agent security skills	23	Experimental	1	—
32	lukaspfisterch/dbl-gateway Reference implementation of the DBL execution boundary. Deterministic event...	22	Experimental	—	Python
33	unpingable/agent_governor Production-oriented constraint system for AI coding agents. Claims require...	22	Experimental	—	Python
34	vorionsys/vorion Open-source AI agent governance - BASIS trust standard, 13,600+ tests, Apache-2.0	22	Experimental	—	TypeScript
35	NawazHaider/steward 🤖 Enable runtime governance for AI systems, ensuring accountability and...	22	Experimental	—	Rust
36	kadubon/agent-lifecycle-certification-poc Public, fully local PoCs for counterfactually auditable lifecycle...	22	Experimental	—	Python
37	dittonovenska/rfc-agent-validator 🔍 Explore IETF RFCs effortlessly with this AI-driven agent that validates...	22	Experimental	—	Python
38	kim7hg/steward 🛡️ Governs AI actions with real-time oversight, ensuring accountability and...	22	Experimental	—	Rust
39	RandallRO/axon Enable autonomous AI workflows with a local-first, zero-trust Rust framework...	22	Experimental	—	Rust
40	Aimaghsoodi/AgentSpec Declarative Agent Behavior — specify, document, and enforce AI agent constraints	22	Experimental	—	HTML
41	nicholasmacaskill/verithra-agentic-proof-public Institutional-grade ZK-compliance infrastructure for financial workflows....	20	Experimental	1	Makefile
42	anmolp1/agentdoctor-oss Diagnose your AI agents before they silently fail. Open-source health...	20	Experimental	1	TypeScript
43	fabulousengineer0211/VMdebugger Simple, privacy-first debugging tool for AI agents. See WHERE agents fail...	19	Experimental	—	HTML
44	eunomia-bpf/linux-trace-ai-agent An experiment AI agent for automatic monitoring of system performance.	18	Experimental	7	Python
45	SkySingh04/TracePR AI-powered tool that analyzes PRs using AI to provide observability...	17	Experimental	24	Go
46	srex-dev/AgentReliabilityEngineering A discipline for governing autonomous AI agents in production.	16	Experimental	2	—
47	ChizhongWang/OpenVerifAIble VerifAIble - Make every bit of information verifiable to everyone	16	Experimental	13	—
48	manosara275704/policy-validation-agent AI-based Policy Validation Agent with retrieval, rule-based analysis, and...	16	Experimental	—	Python
49	TheIbrahimMalik/verisci AI agent for scientific claim verification with LLM reasoning and Neo...	15	Experimental	1	Python
50	anayak314/governance-orchestrator 🌐 Streamline governance and context engineering for coding agents to ensure...	14	Experimental	—	Python
51	suedehed/agentkernel Runtime safety layer for AI agents. Enforce intent. Intercept actions....	14	Experimental	—	Python
52	kawish918/Fixie-AI-Agent-Debugger An intelligent Python debugging assistant powered by AI agents using...	14	Experimental	3	Python
53	nnaulia/dao-governance-portal ⚖️ Enable decentralized voting on proposals with a Governance Token in this...	14	Experimental	—	JavaScript
54	Algiras/debugium Multi-language debugger with real-time web UI and LLM integration via MCP	13	Experimental	2	Rust
55	PovedaAqui/cybertrace-ai [DEPRECATED] CybertraceAI is an open-source AI agent that simplifies network...	13	Experimental	6	Python
56	SalamanderXing/faithful-agent Verifying agents' plans before execution 🐶	12	Experimental	3	TypeScript

Comparisons in this category

agent-devtools and agentlens (37 vs 25)