Setup · League 2

d1-ultra

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
Missing
Date run
2026-10-19 to 2026-10-25
Price
Missing
Model type
Missing
Weights
Missing
Runs on
Missing
Reasoning setting
Missing
Confidence source
Missing
Rules text
Missing
Option groups
not recorded; in this data 1 decisions were split into groups of 142
Sampling settings
Missing
Notes
Missing

Missing B7 fields: every B7 field

Results in League 2

Error rate (PR)
30.327.3 to 33.4
Decisions
2,071 (2,071 scored, 0 invalid)
Engine's best play
48.6%
Blunder rate
22.4%
P95 equity loss
0.289
Mean loss, worst 5%
0.487
Median / P90 s per decision
0.23 / 0.41
$ per 1,000 decisions
0.145API price
Risk judgement, margin 0.001
64.0 (95% interval 61.7 to 66.3); risks found 42.0% (289 / 688), right safety 86.0% (702 / 816)
Risk judgement, margin 0.02
63.0 (95% interval 60.8 to 65.3); risks found 41.8% (254 / 607), right safety 84.2% (755 / 897)
No trade-off
567 (left out of every risk metric)

JSON

Risk call card

64.0risk judgement, margin 0.001

right risks289
wrong risks58
needless risks114
missed risks341
right safety702

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

League 2: complete letter-readout records are mostly few-option positions, a selected subset.

Decisions
2,071
Eligible (full probability distribution)
2,070
Left out, by reason
asked in groups of options 1
Close choices
61.0% (1,262 / 2,070)
Ties in the top two
142 decisions (142 at a positive probability, 0 at 0; the two most likely plays tied: 60, the second tied with the third: 82); 116 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
38.8% (490 / 1,262) of the close choices; 23.7% (490 / 2,070) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices1,2620.301median 0.2730.219median 0.1970.520median 0.470
Other decisions8080.547median 0.5460.147median 0.1400.695median 0.693
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices0221322842631711301105892
Other decisions001068102107130106115170
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices1,26247.4%598 / 1,26230.4%384 / 1,26211.3%142 / 1,26225.8%326 / 1,262381 / 469 / 272 / 123 / 17
Other decisions80855.8%451 / 80841.2%333 / 80815.6%126 / 80832.8%265 / 808127 / 317 / 253 / 92 / 19
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices1,2620.109median 0.0570.077median 0.0180.102median 0.041
Other decisions8080.150median 0.0790.034median 0.0000.150median 0.076
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00160.5%267 / 44149.3%223 / 452
margin 0.0261.7%243 / 39449.5%247 / 499
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00164.2%441 / 68755.4%452 / 81665.1%369 / 56758.0%47 / 81, under 200 decisions59.6%140 / 23568.5%254 / 371
margin 0.0265.0%394 / 60655.6%499 / 89765.1%369 / 567N/A0 / 059.6%140 / 23568.5%254 / 371

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001402 decisions57.6%crude 58.1% (155 / 267)69.5%crude 64.4% (87 / 135), under 200 decisions−11.8 points95% interval −20.5 to −0.7−6.4 points95% interval −15.4 to +3.2
margin 0.02351 decisions56.7%crude 57.6% (140 / 243)64.3%crude 63.9% (69 / 108), under 200 decisions−7.6 points95% interval −18.9 to +4.2−6.3 points95% interval −17.1 to +4.8

By game phase

PhaseError rate (PR)Decisions
Opening27.7294
Contact36.01,263
Holding gameToo few decisions93
Race15.0263
Bear-offToo few decisions158