kaganhitit11/mergeval
mergeval is a unified tool that lets you merge and evaluate large language models in one step. It combines the power of mergekit (https://github.com/arcee-ai/mergekit) for model merging and lm-eval-harness (https://github.com/EleutherAI/lm-evaluation-harness) for standardized benchmarking — all through a single command.
Stars
2
Forks
—
Language
Python
License
MIT
Category
Last pushed
Nov 03, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/kaganhitit11/mergeval"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
google/langfun
OO for LLMs
tanaos/artifex
Small Language Model Inference, Fine-Tuning and Observability. No GPU, no labeled data needed.
vulnerability-lookup/VulnTrain
A tool to generate datasets and models based on vulnerabilities descriptions from @Vulnerability-Lookup.
DataScienceUIBK/HintEval
HintEvalđź’ˇ: A Comprehensive Framework for Hint Generation and Evaluation for Questions
microsoft/LMChallenge
A library & tools to evaluate predictive language models.