Codesota · Benchmark · HellaSwagHome/Leaderboards/HellaSwag
Unknown

HellaSwag.

70K sentence completion problems testing commonsense natural language inference.

Paper ↗Leaderboard ↓
§ 01 · Leaderboard

Results by metric.

Only 4 models on this benchmark
Help build the community leaderboard — submit your model results.
Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

accuracy

Accuracy is the reported evaluation metric for HellaSwag. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for accuracyverifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01gpt-4o
Non-API entry from src
unverified95.32026N/ALooks wrong?
02gemini-15-pro
Non-API entry from src
unverified92.52026N/ALooks wrong?
03claude-35-sonnet
Non-API entry from src
unverified892026N/ALooks wrong?
04llama-3-70b
Non-API entry from src
unverified882026N/ALooks wrong?
§ 04 · Submit a result

Add to the leaderboard.

Submit a Result

Sign in to submit benchmark results for HellaSwag.

Sign in
← Back to Leaderboards