Evaluation Frameworks Metrics NLP Tools

There are 5 evaluation frameworks metrics tools tracked. The highest-rated is FudanSELab/ClassEval at 39/100 with 145 stars.

Get all 5 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=evaluation-frameworks-metrics&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 FudanSELab/ClassEval

Benchmark ClassEval for class-level code generation.

39
Emerging
2 microsoft/NeMoEval

A Benchmark Tool for Natural Language-based Network Management

32
Emerging
3 apartresearch/specificityplus

👩‍💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved...

30
Emerging
4 claws-lab/XLingEval

Code and Resources for the paper, "Better to Ask in English: Cross-Lingual...

27
Experimental
5 HICAI-ZJU/SciKnowEval

SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models

20
Experimental