Extended HumanEval with 80x more test cases. Tests code robustness and edge case handling.
Pass@1 is the reported evaluation metric for HumanEval+. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.
Higher is better
Muted rows were not state of the art when published — an earlier or same-year result already scored better.
| Rank | Model | Trust | Score | Year | Links | Fix |
|---|---|---|---|---|---|---|
| 01 | Qwen2.5-Coder-32B | verified | 87.2 | 2026 | Source ↗ | Looks wrong? |
| 02 | DeepSeek-V3 | verified | 86.6 | 2026 | Source ↗ | Looks wrong? |
| 03 | GPT-4o | verified | 86 | 2026 | Source ↗ | Looks wrong? |
| 04 | DeepSeek-Coder-V2 | verified | 82.3 | 2026 | Source ↗ | Looks wrong? |
| 05 | DeepSeek-Coder-33B | verified | 75 | 2026 | Source ↗ | Looks wrong? |