Setup · League 2

Grok 4.7low

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
Missing
Date run
2026-10-20 to 2026-10-26
Price
Missing
Model type
Missing
Weights
Missing
Runs on
Missing
Reasoning setting
Missing
Confidence source
Missing
Rules text
Missing
Option groups
not recorded; in this data 250 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
Sampling settings
Missing
Notes
Missing
Earlier name
Grok 4.7 (off) (renamed on 28 Oct 2026 to the reasoning effort its requests sent)

Missing B7 fields: every B7 field

Results in League 2

Error rate (PR)
19.116.9 to 21.4
Decisions
2,152 (2,152 scored, 0 invalid)
Engine's best play
60.8%
Blunder rate
15.1%
P95 equity loss
0.209
Mean loss, worst 5%
0.354
Median / P90 s per decision
24.3 / 110.2
$ per 1,000 decisions
32.813API-equivalent (subscription)
Risk judgement, margin 0.001
67.7 (95% interval 66.0 to 69.5); risks found 42.3% (295 / 697), right safety 93.0% (852 / 916)
Risk judgement, margin 0.02
67.0 (95% interval 64.9 to 69.1); risks found 42.8% (263 / 614), right safety 91.1% (910 / 999)
No trade-off
539 (left out of every risk metric)

JSON

Risk call card

67.7risk judgement, margin 0.001

right risks295
wrong risks54
needless risks64
missed risks348
right safety852

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

League 2: complete letter-readout records are mostly few-option positions, a selected subset.

Decisions
2,152
Eligible (full probability distribution)
0
Left out, by reason
not audited 411; one letter only, or a program 1,741
Close choices
N/A no full probability distribution

By game phase

PhaseError rate (PR)Decisions
Opening17.6297
Contact25.41,320
Holding gameToo few decisions121
Race2.9217
Bear-offToo few decisions197