TIGER-AI-Lab/MMLU-Pro

The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]

/ 100

Established

347 stars.

No Package No Dependents

Maintenance 10 / 25

Adoption 10 / 25

Maturity 16 / 25

Community 20 / 25

Stars

347

Forks

Language

Python

License

Apache-2.0

Category

Last pushed

Feb 20, 2026

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/TIGER-AI-Lab/MMLU-Pro"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Related models

ExtensityAI/symbolicai

A neurosymbolic perspective on LLMs

zhudotexe/fanoutqa

Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language...

deep-symbolic-mathematics/LLM-SR

[ICLR 2025 Oral] This is the official repo for the paper "LLM-SR" on Scientific Equation...

HiThink-Research/MME-Finance

[MM 2025] A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning

xlang-ai/Binder

[ICLR 2023] Code for the paper "Binding Language Models in Symbolic Languages"