chat model, one letter · League 3

GPT-6 Astralow

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
gpt-6-astra
Provider or endpoint
ChatGPT subscription
Date run
2026-10-20 to 2026-10-24
Price
$10.0 / $50.0 per million tokens in / out; API-equivalent (subscription); price date not recorded
Model type
chat model, one letter
Weights
closed
Runs on
subscription
Reasoning setting
reasoning effort low, the lowest gpt-6-astra accepts (none and minimal are rejected)
Confidence source
none
Rules text
long
Option groups
up to 26 options per request (letters A-Z); more legal plays are split into equal groups, a winner per group, then among the winners; in this data 169 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
Sampling settings
not sent (API default)
Notes
ChatGPT subscription (Codex backend)
Earlier name
GPT-6 Astra (off) (renamed on 28 Oct 2026 to the reasoning effort its requests sent)

Missing B7 fields: price.date

Results in League 3

Error rate (PR)
11.89.5 to 14.2
Decisions
1,251 (1,251 scored, 0 invalid)
Engine's best play
66.3%
Blunder rate
9.4%
P95 equity loss
0.129
Mean loss, worst 5%
0.246
Median / P90 s per decision
3.94 / 14.0
$ per 1,000 decisions
49.737API-equivalent (subscription)
Risk judgement, margin 0.001
75.8 (95% interval 73.1 to 78.5); risks found 57.2% (226 / 395), right safety 94.4% (486 / 515)
Risk judgement, margin 0.02
74.9 (95% interval 71.9 to 77.9); risks found 58.1% (209 / 360), right safety 91.8% (505 / 550)
No trade-off
341 (left out of every risk metric)

JSON

Risk call card

75.8risk judgement, margin 0.001

right risks226
wrong risks14
needless risks29
missed risks155
right safety486

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
1,251
Eligible (full probability distribution)
0
Left out, by reason
one letter only, or a program 1,251
Close choices
N/A no full probability distribution

By game phase

PhaseError rate (PR)Decisions
OpeningToo few decisions179
Contact15.6799
Holding gameToo few decisions49
RaceToo few decisions136
Bear-offToo few decisions88