Codegrammer999/prompt-bench
This is a benchmark suite comparing zero-shot, few-shot, Chain-of-Thought, and self-consistency on a classification task. Each run is traced in Langfuse with accuracy scores, latency, and token usage. The findings.md documents which technique wins and why.
Stars
1
Forks
—
Language
Python
License
—
Category
Last pushed
Mar 07, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/Codegrammer999/prompt-bench"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
microsoft/promptbench
A unified evaluation framework for large language models
uptrain-ai/uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications....
gabe-mousa/Apolien
AI Safety Evaluation Library
microsoftarchive/promptbench
A unified evaluation framework for large language models
babelcloud/LLM-RGB
LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.