Codesota · Benchmark · ARC-ChallengeHome/Leaderboards/ARC-Challenge
Unknown

ARC-Challenge.

7,787 science questions requiring reasoning. Challenge set contains harder questions that retrieval fails on.

Paper ↗Leaderboard ↓
§ 01 · Leaderboard

Results by metric.

Only 4 models on this benchmark
Help build the community leaderboard — submit your model results.
Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

accuracy

Accuracy is the reported evaluation metric for ARC-Challenge. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for accuracyverifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01claude-35-sonnet
Non-API entry from src
unverified96.72026N/ALooks wrong?
02gpt-4o
Non-API entry from src
unverified96.42026N/ALooks wrong?
03gemini-15-pro
Non-API entry from src
unverified94.82026N/ALooks wrong?
04llama-3-70b
Non-API entry from src
unverified932026N/ALooks wrong?
Research graph

Research connected to this record.

1 question · 3 claims · 1 experiment

Questions, claims, and experiments linked through CodeSOTA’s public evidence graph.

Research questions · 1

Claims · 3

Experiments · 1

Explore the research graph →
§ 04 · Submit a result

Add to the leaderboard.

Submit a Result

Sign in to submit benchmark results for ARC-Challenge.

Sign in
← Back to Leaderboards