Loading benchmark catalogue
Compare performance benchmarks, coding intelligence, reasoning evaluations, context limits, and API economics between GPT-6 Astra (OpenAI) and Beam 1.0 501B A23B (Reflection AI).
| Metric / Capability | GPT-6 Astra | Beam 1.0 501B A23B |
|---|---|---|
| Developer / Organization | OpenAI | Reflection AI |
| Release Date | 2026-09-04 | 2026-10-16 |
| Deployment / Weights | Proprietary Cloud API | Open Weights |
| Context Window | 1.1M tokens (1,050,000 tokens) | 1.0M tokens (1,048,576 tokens) |
| Input Pricing (/1M Tokens) | $10 | Free (Open Weights) |
| Output Pricing (/1M Tokens) | $50 | Free (Open Weights) |
| Benchmark / Domain | GPT-6 Astra | Beam 1.0 501B A23B | Advantage |
|---|---|---|---|
Artificial Analysis Intelligence Index Composite index aggregating 10+ evaluations of general reasoning and knowledge. | 52.7% | — | — |
Artificial Analysis Coding Index Composite index of coding and software-engineering evaluations. | 76.9% | — | — |
Artificial Analysis Agentic Index Composite index of tool-use and long-horizon agentic tasks. | 51.0% | — | — |
Artificial Analysis Coding Agent Index v2.0 Composite index of coding-agent systems (model + harness) across FrontierCode v1.1, SWE-Atlas-QnA, and Terminal-Bench v4. | 54.7% | — | — |
SWE-bench Pro Harder, contamination-resistant successor to SWE-bench spanning multiple languages. | — | 66.1% | — |
Terminal-Bench 4.0 Sandboxed command-line tasks requiring shell and file-system operation. | 57.9% | — | — |
ARC-AGI-2 Novel visual grid puzzles requiring abstract rule induction. | 95.0% | — | — |
GPQA Diamond Graduate-level physics, chemistry, and biology questions written by domain experts. | 96.0% | 90.6% | GPT-6 Astra (+6%) |
Humanity's Last Exam Expert-written questions across hundreds of disciplines designed to resist saturation. | — | 36.0% | — |
FrontierMath v2 (Tiers 1-3) Unpublished, research-level mathematics problems across Tiers 1-3. | 93.7% | — | — |
Design Arena ELO Human-preference ELO across UI, 3D, data-visualization, and game-dev generations. | — | 1227 | — |
GPT-6 Astra leads across 1 evaluated benchmarks compared to 0 for Beam 1.0 501B A23B, showing notable advantages in GPQA Diamond.
GPT-6 Astra offers a larger context capacity of 1.1M tokens (1,050,000 tokens), compared to 1.0M tokens for Beam 1.0 501B A23B.
Beam 1.0 501B A23B is more economical. Input tokens cost $Free (Open Weights)/M tokens compared to $10/M tokens for GPT-6 Astra.
GPT-6 Astra is a proprietary cloud API. Beam 1.0 501B A23B is an open-weights model.
Analyze 130+ models side-by-side using interactive radar charts, cost-efficiency quadrant plots, and live dataset filters on the full NeuBench index.
Open Interactive Comparator