Reasoning benchmark

AIME leaderboard

5 models have a published score. Reflection Beam 1.0 (Reflection AI) leads with 97.7, and the spread to the lowest score, Gemma 4 26B A4B at 88.3, is 9.4 points. The highest-scoring model you can deploy on OpenLLM Buddy is Qwen3.6 27B, ranked 3 of 5 with 94.1. Sources report different settings for this test, such as test year, version, or reasoning effort. Each setting is listed in the source table, so compare close scores with care.

Best openllm buddy catalog

94.1

Qwen3.6 27B

3 models scored

Best open weights

97.7

Reflection Beam 1.0

2 models scored

Best closed api

No published score

0 models scored

AIME scores

Pass@1 accuracy, usually averaged over several samples per problem. No partial credit.

What it measures

Each AIME year has 30 problems (AIME I and II) with integer answers from 0 to 999, covering algebra, geometry, number theory, and combinatorics. Labs report a specific year, which is shown next to each score.

How it is scored

Pass@1 accuracy, usually averaged over several samples per problem. No partial credit.

Why it matters

Fresh contest years limit training-data contamination and reward careful multi-step math.

Official benchmark page

More reasoning tests

Sources

ModelTestScoreSettingSource
Reflection Beam 1.0AIME97.7AIME 2026, BF16Hugging Face model card (Beam-1.0-501B-A23B)
gpt-oss-120bAIME95.8AIME 2024, high effort, no toolsgpt-oss model card paper (arXiv 2508.10925), Table 3
Qwen3.6 27BAIME94.1AIME 2026Qwen3.6-27B model card (Hugging Face)
Gemma 4 31BAIME89.2AIME 2026, no toolsGemma 4 31B IT model card (Hugging Face)
Gemma 4 26B A4BAIME88.3AIME 2026, no toolsGemma 4 31B IT model card (Hugging Face), 26B A4B column

Scores are published results from model cards, lab reports, and public leaderboards, each linked to its source. Settings such as thinking mode or test version differ between sources and are shown next to each score. OpenLLM Buddy catalog models are uncensored fine-tunes; their scores are those of the official base model. Data collected 2026-10-30. How the index works