Setup · League 2

Jev 1.14

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
Missing
Date run
2026-10-19 to 2026-10-26
Price
Missing
Model type
Missing
Weights
Missing
Runs on
Missing
Reasoning setting
Missing
Confidence source
Missing
Rules text
Missing
Option groups
not recorded; in this data 2 decisions were split into groups of 129, 164
Sampling settings
Missing
Notes
Missing

Missing B7 fields: every B7 field

Results in League 2

Error rate (PR)
31.728.3 to 35.7
Decisions
1,912 (1,912 scored, 0 invalid)
Engine's best play
46.2%
Blunder rate
24.7%
P95 equity loss
0.286
Mean loss, worst 5%
0.465
Median / P90 s per decision
0.19 / 0.24
$ per 1,000 decisions
0.173API price
Risk judgement, margin 0.001
59.3 (95% interval 57.1 to 61.4); risks found 29.1% (184 / 632), right safety 89.4% (657 / 735)
Risk judgement, margin 0.02
59.2 (95% interval 57.0 to 61.4); risks found 29.9% (167 / 559), right safety 88.5% (715 / 808)
No trade-off
545 (left out of every risk metric)

JSON

Risk call card

59.3risk judgement, margin 0.001

right risks184
wrong risks47
needless risks78
missed risks401
right safety657

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

League 2: complete letter-readout records are mostly few-option positions, a selected subset.

Decisions
1,912
Eligible (full probability distribution)
507
Left out, by reason
not audited 1,405
Close choices
45.6% (231 / 507)
Ties in the top two
35 decisions (35 at a positive probability, 0 at 0; the two most likely plays tied: 7, the second tied with the third: 28); 13 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
36.8% (85 / 231) of the close choices; 16.8% (85 / 507) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices2310.377median 0.3600.270median 0.2700.647median 0.630
Other decisions2760.656median 0.6700.149median 0.1500.806median 0.830
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices00413324656292526
Other decisions000232536565995
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices23146.3%107 / 23131.6%73 / 23113.9%32 / 23125.1%58 / 23170 / 78 / 59 / 22 / 2
Other decisions27650.7%140 / 27632.6%90 / 27615.2%42 / 27627.9%77 / 27659 / 117 / 70 / 28 / 2
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices2310.096median 0.0580.077median 0.0310.097median 0.054
Other decisions2760.137median 0.0750.045median 0.0000.144median 0.078
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00157.7%56 / 97, under 200 decisions39.7%29 / 73, under 200 decisions
margin 0.0256.5%48 / 85, under 200 decisions43.5%37 / 85, under 200 decisions
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00155.4%97 / 175, under 200 decisions38.0%73 / 192, under 200 decisions43.6%61 / 140, under 200 decisions52.2%12 / 23, under 200 decisions59.6%34 / 57, under 200 decisions53.7%51 / 95, under 200 decisions
margin 0.0255.9%85 / 152, under 200 decisions39.5%85 / 21543.6%61 / 140, under 200 decisionsN/A0 / 059.6%34 / 57, under 200 decisions53.7%51 / 95, under 200 decisions

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001104 decisions50.0%crude 51.8% (29 / 56), under 200 decisions84.2%crude 83.3% (40 / 48), under 200 decisions−34.2 points95% interval −55.0 to −4.2−31.5 points95% interval −45.4 to −14.8
margin 0.0289 decisions52.6%crude 54.2% (26 / 48), under 200 decisions81.1%crude 82.9% (34 / 41), under 200 decisions−28.5 points95% interval −53.3 to +5.0−28.8 points95% interval −46.8 to −8.6

By game phase

PhaseError rate (PR)Decisions
Opening37.6272
Contact35.11,237
Holding gameToo few decisions40
Race16.1220
Bear-offToo few decisions143