agenta and ai-llmops-index

About agenta

Agenta-AI/agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Supports 50+ LLM models with bring-your-own model capabilities, and includes OpenTelemetry-native tracing for production observability compatible with OpenLLMetry and OpenInference standards. Features version-controlled prompt management with branching and environments, alongside flexible evaluation via 20+ pre-built evaluators, LLM-as-judge, and custom evaluators accessible through both UI and programmatic APIs. Self-hostable via Docker Compose with multi-environment support and integrations for major LLM providers and frameworks.

About ai-llmops-index

alebgn1/ai-llmops-index

Provide a comprehensive, regularly updated index of AI LLM providers, vendors, and inference cost data for informed decision-making.