GSO-Bench
GSO-Bench · evaluates AI models on real-world open-source software engineering tasks, testing the ability to understand and resolve actual GitHub issues.
The Frontier
Best score over time · one chart, every benchmark
Full rankings
26 models tested · sorted by score
| # | Model | Score |
|---|---|---|
| 1 | 88.2 | |
| 2 | 79.4 | |
| 3 | 78.4 | |
| 4 | 76.5 | |
| 5 | 47.1 | |
| 6 | 44.1 | |
| 7 | 41.2 | |
| 8 | 37.3 | |
| 9 | 31.4 | |
| 10 | 27.4 | |
| 11 | 26.5 | |
| 12 | 22.6 | |
| 13 | 18.6 | |
| 14 | 14.7 | |
| 15 | 13.7 | |
| 16 | 9.8 | |
| 17 | 8.8 | |
| 18 | 6.9 | |
| 19 | 6.9 | |
| 20 | 4.9 | |
| 21 | 4.9 | |
| 22 | 4.6 | |
| 23 | 3.9 | |
| 24 | 3.8 | |
| 25 | 3.6 | |
| 26 | 1.3 |
Score distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Benchmarks that track with GSO-Bench
Pearson correlation across models scored on both benchmarks. Closer to 1 = strongly predictive.
Frequently asked
About GSO-Bench
What does GSO-Bench measure?
GSO-Bench · evaluates AI models on real-world open-source software engineering tasks, testing the ability to understand and resolve actual GitHub issues. 26 AI models have been tested on it. Scores range from 1.3 to 88.2 out of 100.
Which model leads on GSO-Bench?
Claude Fable 5.1 from Anthropic leads GSO-Bench with a score of 88.2. The median score across 26 tested models is 16.7.
Is GSO-Bench saturated?
No · the top score is 88.2 out of 100 (88%). There is still meaningful room for improvement on GSO-Bench.
Does GSO-Bench predict performance on other benchmarks?
Yes · GSO-Bench scores correlate 0.96 with Remote Labor Index across 11 shared models. Models that do well on GSO-Bench tend to do well on Remote Labor Index.
How often is GSO-Bench data refreshed?
BenchGecko pulls updates daily. New model scores on GSO-Bench appear as soon as they are published by Epoch AI or the model provider.
- Category
- Code
- Max score
- 100
- Models
- 26
- Updated
- 2026-09-04
Top on GSO-Bench
Claude Fable 5.1 · 88.2GPT-6 Astra · 79.4Claude Fable 5 · 78.4GPT-5.6 Sol · 76.5Claude Opus 4.8 · 47.1More code benchmarks
Same category · related evaluations