decision model · League 1

SubQ Snap Preview

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
subq-snap-preview
Provider or endpoint
SubQ API
Date run
2026-10-15 to 2026-10-26
Price
$0.05 / $0.0 per million tokens in / out; API price; price date not recorded
Model type
decision model
Weights
Missing
Runs on
API
Reasoning setting
none (decision model)
Confidence source
decision-model probability
Rules text
long
Option groups
up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; in this data 1 decisions were split into groups of 178
Sampling settings
not sent (decision request)
Notes
Missing

Missing B7 fields: weights, price.date

Results in League 1

Error rate (PR)
43.939.3 to 48.8
Decisions
2,200 (2,200 scored, 0 invalid)
Engine's best play
42.3%
Blunder rate
31.8%
P95 equity loss
0.399
Mean loss, worst 5%
0.634
Median / P90 s per decision
0.24 / 0.32
$ per 1,000 decisions
0.193API price
Risk judgement, margin 0.001
56.5 (95% interval 53.8 to 59.1); risks found 37.9% (297 / 783), right safety 75.1% (673 / 896)
Risk judgement, margin 0.02
55.9 (95% interval 53.1 to 58.8); risks found 38.4% (263 / 685), right safety 73.4% (730 / 994)
No trade-off
521 (left out of every risk metric)

JSON

Risk call card

56.5risk judgement, margin 0.001

right risks297
wrong risks127
needless risks223
missed risks359
right safety673

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
2,200
Eligible (full probability distribution)
1,968
Left out, by reason
asked in groups of options 1; not audited 231
Close choices
48.9% (962 / 1,968)
Ties in the top two
0 decisions (0 at a positive probability, 0 at 0; the two most likely plays tied: 0, the second tied with the third: 0); 0 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
35.1% (338 / 962) of the close choices; 17.2% (338 / 1,968) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices9620.342median 0.3310.246median 0.2340.587median 0.569
Other decisions1,0060.598median 0.6010.146median 0.1390.744median 0.756
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices016661161681611481049093
Other decisions0372781106171197163251
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices96252.3%503 / 96230.1%290 / 96211.4%110 / 96227.8%267 / 962252 / 372 / 228 / 98 / 12
Other decisions1,00656.7%570 / 1,00632.0%322 / 1,00611.5%116 / 1,00626.4%266 / 1,006219 / 425 / 247 / 105 / 10
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices9620.131median 0.0700.118median 0.0450.144median 0.059
Other decisions1,0060.139median 0.0740.065median 0.0000.147median 0.076
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00146.8%176 / 37643.4%162 / 373
margin 0.0245.7%153 / 33544.7%185 / 414
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00152.6%376 / 71546.5%373 / 80247.2%213 / 45146.6%41 / 88, under 200 decisions56.4%124 / 22051.8%211 / 407
margin 0.0253.4%335 / 62746.5%414 / 89047.2%213 / 451N/A0 / 056.4%124 / 22051.8%211 / 407

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001364 decisions53.8%crude 54.5% (96 / 176), under 200 decisions70.2%crude 69.7% (131 / 188), under 200 decisions−16.4 points95% interval −29.6 to −1.5−15.1 points95% interval −25.8 to −3.6
margin 0.02305 decisions54.4%crude 54.2% (83 / 153), under 200 decisions69.6%crude 67.1% (102 / 152), under 200 decisions−15.2 points95% interval −29.1 to +3.2−12.9 points95% interval −24.6 to +0.9

By game phase

PhaseError rate (PR)Decisions
Opening35.0307
Contact53.61,375
Holding gameToo few decisions82
Race20.8295
Bear-offToo few decisions141