Setup · League 2
d1-ultra
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-19 to 2026-10-25
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 1 decisions were split into groups of 142
- Sampling settings
- Missing
- Notes
- Missing
Missing B7 fields: every B7 field
Results in League 2
- Error rate (PR)
- 30.327.3 to 33.4
- Decisions
- 2,071 (2,071 scored, 0 invalid)
- Engine's best play
- 48.6%
- Blunder rate
- 22.4%
- P95 equity loss
- 0.289
- Mean loss, worst 5%
- 0.487
- Median / P90 s per decision
- 0.23 / 0.41
- $ per 1,000 decisions
- 0.145API price
- Risk judgement, margin 0.001
- 64.0 (95% interval 61.7 to 66.3); risks found 42.0% (289 / 688), right safety 86.0% (702 / 816)
- Risk judgement, margin 0.02
- 63.0 (95% interval 60.8 to 65.3); risks found 41.8% (254 / 607), right safety 84.2% (755 / 897)
- No trade-off
- 567 (left out of every risk metric)
Risk call card
64.0risk judgement, margin 0.001
right risks289
wrong risks58
needless risks114
missed risks341
right safety702
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
League 2: complete letter-readout records are mostly few-option positions, a selected subset.
- Decisions
- 2,071
- Eligible (full probability distribution)
- 2,070
- Left out, by reason
- asked in groups of options 1
- Close choices
- 61.0% (1,262 / 2,070)
- Ties in the top two
- 142 decisions (142 at a positive probability, 0 at 0; the two most likely plays tied: 60, the second tied with the third: 82); 116 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 38.8% (490 / 1,262) of the close choices; 23.7% (490 / 2,070) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 1,262 | 0.301median 0.273 | 0.219median 0.197 | 0.520median 0.470 |
| Other decisions | 808 | 0.547median 0.546 | 0.147median 0.140 | 0.695median 0.693 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 22 | 132 | 284 | 263 | 171 | 130 | 110 | 58 | 92 |
| Other decisions | 0 | 0 | 10 | 68 | 102 | 107 | 130 | 106 | 115 | 170 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 1,262 | 47.4%598 / 1,262 | 30.4%384 / 1,262 | 11.3%142 / 1,262 | 25.8%326 / 1,262 | 381 / 469 / 272 / 123 / 17 |
| Other decisions | 808 | 55.8%451 / 808 | 41.2%333 / 808 | 15.6%126 / 808 | 32.8%265 / 808 | 127 / 317 / 253 / 92 / 19 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 1,262 | 0.109median 0.057 | 0.077median 0.018 | 0.102median 0.041 |
| Other decisions | 808 | 0.150median 0.079 | 0.034median 0.000 | 0.150median 0.076 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 60.5%267 / 441 | 49.3%223 / 452 |
| margin 0.02 | 61.7%243 / 394 | 49.5%247 / 499 |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 64.2%441 / 687 | 55.4%452 / 816 | 65.1%369 / 567 | 58.0%47 / 81, under 200 decisions | 59.6%140 / 235 | 68.5%254 / 371 |
| margin 0.02 | 65.0%394 / 606 | 55.6%499 / 897 | 65.1%369 / 567 | N/A0 / 0 | 59.6%140 / 235 | 68.5%254 / 371 |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001402 decisions | 57.6%crude 58.1% (155 / 267) | 69.5%crude 64.4% (87 / 135), under 200 decisions | −11.8 points95% interval −20.5 to −0.7 | −6.4 points95% interval −15.4 to +3.2 |
| margin 0.02351 decisions | 56.7%crude 57.6% (140 / 243) | 64.3%crude 63.9% (69 / 108), under 200 decisions | −7.6 points95% interval −18.9 to +4.2 | −6.3 points95% interval −17.1 to +4.8 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 27.7 | 294 |
| Contact | 36.0 | 1,263 |
| Holding game | Too few decisions | 93 |
| Race | 15.0 | 263 |
| Bear-off | Too few decisions | 158 |