bin123apple/AutoCoder

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

43
/ 100
Emerging

Built on DeepSeek-Coder and CodeQwen foundations, AutoCoder includes an integrated code interpreter that automatically installs dependencies and iteratively executes code until validation succeeds—enabling external library access unlike GPT-4o. Available in multiple sizes (33B, 6.7B, 7B variants), it benchmarks at 90.9% on HumanEval base and 82.5% on MBPP, with selective code execution only when explicitly requested by users rather than running all generated code.

853 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 17 / 25

How are scores calculated?

Stars

853

Forks

72

Language

Python

License

Apache-2.0

Category

ai-code-editors

Last pushed

Jul 06, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/bin123apple/AutoCoder"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.