Codesota · Benchmark · SVAMPHome/Leaderboards/SVAMP
Unknown

SVAMP.

1,000 elementary-level math word problems testing robustness of arithmetic reasoning.

Paper ↗Leaderboard ↓
§ 01 · Leaderboard

Results by metric.

Only 3 models on this benchmark
Help build the community leaderboard — submit your model results.
Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

accuracy

Accuracy is the reported evaluation metric for SVAMP. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for accuracyverifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01gpt-4o
Non-API entry from src
unverified93.72026N/ALooks wrong?
02claude-35-sonnet
Non-API entry from src
unverified91.22026N/ALooks wrong?
03llama-3-70b
Non-API entry from src
unverified89.52026N/ALooks wrong?
§ 04 · Submit a result

Add to the leaderboard.

Submit a Result

Sign in to submit benchmark results for SVAMP.

Sign in
← Back to Leaderboards