domaineval/DomainEval

DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference code and tests) covering six domains (i.e., Computation, Basic, Network, Cryptography, Visualization, System).

20
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 5 / 25
Maturity 1 / 25
Community 14 / 25

How are scores calculated?

Stars

14

Forks

3

Language

Python

License

—

Category

code-model-training

Last pushed

Dec 12, 2024

Commits (30d)

0

GitHub
Code Model Training · 76 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ai-coding/domaineval/DomainEval"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

k4black/codebleu

Pip compatible CodeBLEU metric implementation available for linux/macos/win

65

LiveCodeBench/LiveCodeBench

Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of...

53

EdinburghNLP/code-docstring-corpus

Preprocessed Python functions and docstrings for automated code documentation (code2doc) and...

48

hendrycks/apps

APPS: Automated Programming Progress Standard (NeurIPS 2021)

46

alxschwrz/codex_py2cpp

Converts python code into c++ by using OpenAI CODEX.

43

Explore AI Coding Tools

All categories Trending AI Coding directory Insights