decision model · League 1
SubQ Snap Preview
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- subq-snap-preview
- Provider or endpoint
- SubQ API
- Date run
- 2026-10-15 to 2026-10-26
- Price
- $0.05 / $0.0 per million tokens in / out; API price; price date not recorded
- Model type
- decision model
- Weights
- Missing
- Runs on
- API
- Reasoning setting
- none (decision model)
- Confidence source
- decision-model probability
- Rules text
- long
- Option groups
- up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; in this data 1 decisions were split into groups of 178
- Sampling settings
- not sent (decision request)
- Notes
- Missing
Missing B7 fields: weights, price.date
Results in League 1
- Error rate (PR)
- 43.939.3 to 48.8
- Decisions
- 2,200 (2,200 scored, 0 invalid)
- Engine's best play
- 42.3%
- Blunder rate
- 31.8%
- P95 equity loss
- 0.399
- Mean loss, worst 5%
- 0.634
- Median / P90 s per decision
- 0.24 / 0.32
- $ per 1,000 decisions
- 0.193API price
- Risk judgement, margin 0.001
- 56.5 (95% interval 53.8 to 59.1); risks found 37.9% (297 / 783), right safety 75.1% (673 / 896)
- Risk judgement, margin 0.02
- 55.9 (95% interval 53.1 to 58.8); risks found 38.4% (263 / 685), right safety 73.4% (730 / 994)
- No trade-off
- 521 (left out of every risk metric)
Risk call card
56.5risk judgement, margin 0.001
right risks297
wrong risks127
needless risks223
missed risks359
right safety673
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
- Decisions
- 2,200
- Eligible (full probability distribution)
- 1,968
- Left out, by reason
- asked in groups of options 1; not audited 231
- Close choices
- 48.9% (962 / 1,968)
- Ties in the top two
- 0 decisions (0 at a positive probability, 0 at 0; the two most likely plays tied: 0, the second tied with the third: 0); 0 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 35.1% (338 / 962) of the close choices; 17.2% (338 / 1,968) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 962 | 0.342median 0.331 | 0.246median 0.234 | 0.587median 0.569 |
| Other decisions | 1,006 | 0.598median 0.601 | 0.146median 0.139 | 0.744median 0.756 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 16 | 66 | 116 | 168 | 161 | 148 | 104 | 90 | 93 |
| Other decisions | 0 | 3 | 7 | 27 | 81 | 106 | 171 | 197 | 163 | 251 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 962 | 52.3%503 / 962 | 30.1%290 / 962 | 11.4%110 / 962 | 27.8%267 / 962 | 252 / 372 / 228 / 98 / 12 |
| Other decisions | 1,006 | 56.7%570 / 1,006 | 32.0%322 / 1,006 | 11.5%116 / 1,006 | 26.4%266 / 1,006 | 219 / 425 / 247 / 105 / 10 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 962 | 0.131median 0.070 | 0.118median 0.045 | 0.144median 0.059 |
| Other decisions | 1,006 | 0.139median 0.074 | 0.065median 0.000 | 0.147median 0.076 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 46.8%176 / 376 | 43.4%162 / 373 |
| margin 0.02 | 45.7%153 / 335 | 44.7%185 / 414 |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 52.6%376 / 715 | 46.5%373 / 802 | 47.2%213 / 451 | 46.6%41 / 88, under 200 decisions | 56.4%124 / 220 | 51.8%211 / 407 |
| margin 0.02 | 53.4%335 / 627 | 46.5%414 / 890 | 47.2%213 / 451 | N/A0 / 0 | 56.4%124 / 220 | 51.8%211 / 407 |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001364 decisions | 53.8%crude 54.5% (96 / 176), under 200 decisions | 70.2%crude 69.7% (131 / 188), under 200 decisions | −16.4 points95% interval −29.6 to −1.5 | −15.1 points95% interval −25.8 to −3.6 |
| margin 0.02305 decisions | 54.4%crude 54.2% (83 / 153), under 200 decisions | 69.6%crude 67.1% (102 / 152), under 200 decisions | −15.2 points95% interval −29.1 to +3.2 | −12.9 points95% interval −24.6 to +0.9 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 35.0 | 307 |
| Contact | 53.6 | 1,375 |
| Holding game | Too few decisions | 82 |
| Race | 20.8 | 295 |
| Bear-off | Too few decisions | 141 |