Setup · League 2
Jev 1.14
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-19 to 2026-10-26
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 2 decisions were split into groups of 129, 164
- Sampling settings
- Missing
- Notes
- Missing
Missing B7 fields: every B7 field
Results in League 2
- Error rate (PR)
- 31.728.3 to 35.7
- Decisions
- 1,912 (1,912 scored, 0 invalid)
- Engine's best play
- 46.2%
- Blunder rate
- 24.7%
- P95 equity loss
- 0.286
- Mean loss, worst 5%
- 0.465
- Median / P90 s per decision
- 0.19 / 0.24
- $ per 1,000 decisions
- 0.173API price
- Risk judgement, margin 0.001
- 59.3 (95% interval 57.1 to 61.4); risks found 29.1% (184 / 632), right safety 89.4% (657 / 735)
- Risk judgement, margin 0.02
- 59.2 (95% interval 57.0 to 61.4); risks found 29.9% (167 / 559), right safety 88.5% (715 / 808)
- No trade-off
- 545 (left out of every risk metric)
Risk call card
59.3risk judgement, margin 0.001
right risks184
wrong risks47
needless risks78
missed risks401
right safety657
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
League 2: complete letter-readout records are mostly few-option positions, a selected subset.
- Decisions
- 1,912
- Eligible (full probability distribution)
- 507
- Left out, by reason
- not audited 1,405
- Close choices
- 45.6% (231 / 507)
- Ties in the top two
- 35 decisions (35 at a positive probability, 0 at 0; the two most likely plays tied: 7, the second tied with the third: 28); 13 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 36.8% (85 / 231) of the close choices; 16.8% (85 / 507) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 231 | 0.377median 0.360 | 0.270median 0.270 | 0.647median 0.630 |
| Other decisions | 276 | 0.656median 0.670 | 0.149median 0.150 | 0.806median 0.830 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 0 | 4 | 13 | 32 | 46 | 56 | 29 | 25 | 26 |
| Other decisions | 0 | 0 | 0 | 2 | 3 | 25 | 36 | 56 | 59 | 95 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 231 | 46.3%107 / 231 | 31.6%73 / 231 | 13.9%32 / 231 | 25.1%58 / 231 | 70 / 78 / 59 / 22 / 2 |
| Other decisions | 276 | 50.7%140 / 276 | 32.6%90 / 276 | 15.2%42 / 276 | 27.9%77 / 276 | 59 / 117 / 70 / 28 / 2 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 231 | 0.096median 0.058 | 0.077median 0.031 | 0.097median 0.054 |
| Other decisions | 276 | 0.137median 0.075 | 0.045median 0.000 | 0.144median 0.078 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 57.7%56 / 97, under 200 decisions | 39.7%29 / 73, under 200 decisions |
| margin 0.02 | 56.5%48 / 85, under 200 decisions | 43.5%37 / 85, under 200 decisions |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 55.4%97 / 175, under 200 decisions | 38.0%73 / 192, under 200 decisions | 43.6%61 / 140, under 200 decisions | 52.2%12 / 23, under 200 decisions | 59.6%34 / 57, under 200 decisions | 53.7%51 / 95, under 200 decisions |
| margin 0.02 | 55.9%85 / 152, under 200 decisions | 39.5%85 / 215 | 43.6%61 / 140, under 200 decisions | N/A0 / 0 | 59.6%34 / 57, under 200 decisions | 53.7%51 / 95, under 200 decisions |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001104 decisions | 50.0%crude 51.8% (29 / 56), under 200 decisions | 84.2%crude 83.3% (40 / 48), under 200 decisions | −34.2 points95% interval −55.0 to −4.2 | −31.5 points95% interval −45.4 to −14.8 |
| margin 0.0289 decisions | 52.6%crude 54.2% (26 / 48), under 200 decisions | 81.1%crude 82.9% (34 / 41), under 200 decisions | −28.5 points95% interval −53.3 to +5.0 | −28.8 points95% interval −46.8 to −8.6 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 37.6 | 272 |
| Contact | 35.1 | 1,237 |
| Holding game | Too few decisions | 40 |
| Race | 16.1 | 220 |
| Bear-off | Too few decisions | 143 |