Setup · League 1

Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
Missing
Date run
2026-10-20 to 2026-10-25
Price
Missing
Model type
Missing
Weights
Missing
Runs on
Missing
Reasoning setting
Missing
Confidence source
Missing
Rules text
Missing
Option groups
not recorded; in this data 180 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
Sampling settings
Missing
Notes
Missing

Missing B7 fields: every B7 field

Results in League 1

Error rate (PR)
45.040.7 to 49.9
Decisions
2,005 (2,005 scored, 0 invalid)
Engine's best play
43.7%
Blunder rate
30.7%
P95 equity loss
0.422
Mean loss, worst 5%
0.680
Median / P90 s per decision
1.48 / 2.71
$ per 1,000 decisions
data-v="4.551">4.551estimate · RTX PRO 6000 Blackwell
Risk judgement, margin 0.001
57.6 (95% interval 56.1 to 59.0); risks found 23.5% (178 / 756), right safety 91.7% (671 / 732)
Risk judgement, margin 0.02
56.7 (95% interval 55.1 to 58.2); risks found 22.8% (157 / 688), right safety 90.6% (725 / 800)
No trade-off
517 (left out of every risk metric)

JSON

Risk call card

57.6risk judgement, margin 0.001

right risks178
wrong risks42
needless risks61
missed risks536
right safety671

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
2,005
Eligible (full probability distribution)
312
Left out, by reason
asked in groups of options 33; incomplete distribution (an option without its own probability) 30; not audited 1,630
Close choices
34.9% (109 / 312)
Ties in the top two
1 decisions (1 at a positive probability, 0 at 0; the two most likely plays tied: 1, the second tied with the third: 0); 1 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
42.2% (46 / 109), under 200 decisions of the close choices; 14.7% (46 / 312) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices1090.482median 0.5020.343median 0.3380.825median 0.874
Other decisions2030.795median 0.8000.133median 0.1240.928median 0.958
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices00002912241547
Other decisions00000031533152
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices10948.6%53 / 109, under 200 decisions17.4%19 / 109, under 200 decisions11.9%13 / 109, under 200 decisions24.8%27 / 109, under 200 decisions40 / 40 / 17 / 10 / 2
Other decisions20356.2%114 / 20327.6%56 / 2037.4%15 / 20328.1%57 / 20347 / 94 / 40 / 20 / 2
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices1090.139median 0.0410.160median 0.0310.105median 0.010
Other decisions2030.132median 0.0860.068median 0.0010.129median 0.075
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00172.5%29 / 40, under 200 decisions53.1%17 / 32, under 200 decisions
margin 0.0271.1%27 / 38, under 200 decisions55.9%19 / 34, under 200 decisions
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00136.7%40 / 109, under 200 decisions28.3%32 / 113, under 200 decisions41.1%37 / 90, under 200 decisions22.2%2 / 9, under 200 decisions44.8%13 / 29, under 200 decisions35.2%25 / 71, under 200 decisions
margin 0.0238.0%38 / 100, under 200 decisions27.9%34 / 122, under 200 decisions41.1%37 / 90, under 200 decisionsN/A0 / 044.8%13 / 29, under 200 decisions35.2%25 / 71, under 200 decisions

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.00184 decisions64.3%crude 65.5% (19 / 29), under 200 decisions82.4%crude 80.0% (44 / 55), under 200 decisions−18.2 points95% interval −33.8 to +14.3−14.5 points95% interval −28.5 to +10.1
margin 0.0278 decisions64.0%crude 66.7% (18 / 27), under 200 decisions80.3%crude 78.4% (40 / 51), under 200 decisions−16.3 points95% interval −36.0 to +17.7−11.8 points95% interval −28.3 to +10.5

By game phase

PhaseError rate (PR)Decisions
Opening35.7310
Contact57.21,259
Holding gameToo few decisions28
Race18.3273
Bear-offToo few decisions135