Llm Evaluation Platforms MLOps Tools

There are 9 llm evaluation platforms tools tracked. 1 score above 70 (verified tier). The highest-rated is kserve/kserve at 76/100 with 5,200 stars. 1 of the top 10 are actively maintained.

Get all 9 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=llm-evaluation-platforms&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for...

76
Verified
2 omegaml/omegaml

MLOps simplified. One-stop AI delivery platform, all the features you need.

58
Established
3 awslabs/aiops-modules

AIOps modules is a collection of reusable Infrastructure as Code (IaC)...

52
Established
4 jina-ai/serve

☁️ Build multimodal AI applications with cloud-native stack

46
Emerging
5 george0st/qgate-sln-mlrun

MLRun/Iguazio/Nuclio quality gate solution. The solution checks a quality of...

43
Emerging
6 demml/opsml

Quality Control for AI Artifact Management

35
Emerging
7 awslabs/fmbench-orchestrator

Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark...

33
Emerging
8 aishwaryaprabhat/BigBertha

BigBertha is an architecture design that demonstrates how automated LLMOps...

32
Emerging
9 botanu-ai/botanu-sdk-python

SDK to track cost-per-outcome for AI workflows

30
Emerging

Comparisons in this category