Codesota · Benchmark · APPSHome/Leaderboards/Code & Software Engineering/Code Generation/APPS
Unknown

APPS.

10,000 coding problems from Codewars, AtCoder, Kattis, and CodeForces. Ranges from introductory to competition level.

Paper ↗Leaderboard ↓
§ 01 · Leaderboard

Results by metric.

Only 3 models on this benchmark
Help build the community leaderboard — submit your model results.
Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

pass@5

Pass@5 is the reported evaluation metric for APPS. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for pass@5verifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01CodeLlama-34B
Fetched from CodeSOTA API on 2026-04-20
verified32.812026Source ↗Looks wrong?
02CodeLlama-13B
Fetched from CodeSOTA API on 2026-04-20
verified23.742026Source ↗Looks wrong?
03CodeLlama-7B
Fetched from CodeSOTA API on 2026-04-20
verified10.762026Source ↗Looks wrong?
§ 04 · Submit a result

Add to the leaderboard.

Submit a Result

Sign in to submit benchmark results for APPS.

Sign in
← Back to Code Generation