Codesota · Benchmark · MBPP+Home/Leaderboards/Code & Software Engineering/Code Generation/MBPP+
Unknown

MBPP+.

Extended MBPP with additional test cases. Uses 399 hand-verified problems from MBPP-sanitized.

Paper ↗Leaderboard ↓Lineage
§ 01 · Leaderboard

Results by metric.

Only 4 models on this benchmark
Help build the community leaderboard — submit your model results.
Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

pass@1

Pass@1 is the reported evaluation metric for MBPP+. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for pass@1verifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01Qwen2.5-Coder-32B
Fetched from CodeSOTA API on 2026-04-20
verified76.42026Source ↗Looks wrong?
02DeepSeek-V3
Fetched from CodeSOTA API on 2026-04-20
verified732026Source ↗Looks wrong?
03GPT-4o
Fetched from CodeSOTA API on 2026-04-20
verified71.22026Source ↗Looks wrong?
04DeepSeek-Coder-33B
Fetched from CodeSOTA API on 2026-04-20
verified662026Source ↗Looks wrong?
Lineage

MBPP+ in context.

See full coding benchmarks lineage →
This benchmark (1)
active2023-05
MBPP+
None yet — this is the current frontier.
§ 04 · Submit a result

Add to the leaderboard.

Submit a Result

Sign in to submit benchmark results for MBPP+.

Sign in
← Back to Code Generation