Setup · League 2
Clef
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-16 to 2026-10-26
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 22 decisions were split into groups of 56, 60, 61, 62, 64, 66, 71, 74, 75, 77, 78, 80, 82, 89, 92, 93, 94, 107
- Sampling settings
- Missing
- Notes
- Missing
Missing B7 fields: every B7 field
Results in League 2
- Error rate (PR)
- 36.533.5 to 39.6
- Decisions
- 1,978 (1,978 scored, 0 invalid)
- Engine's best play
- 44.5%
- Blunder rate
- 27.1%
- P95 equity loss
- 0.334
- Mean loss, worst 5%
- 0.531
- Median / P90 s per decision
- 1.13 / 5.41
- $ per 1,000 decisions
- data-v="5.736">5.736estimate · RTX PRO 6000 Blackwell
- Risk judgement, margin 0.001
- 57.5 (95% interval 55.4 to 59.8); risks found 39.5% (263 / 666), right safety 75.6% (603 / 798)
- Risk judgement, margin 0.02
- 57.6 (95% interval 55.2 to 60.0); risks found 40.6% (240 / 591), right safety 74.6% (651 / 873)
- No trade-off
- 514 (left out of every risk metric)
Risk call card
57.5risk judgement, margin 0.001
right risks263
wrong risks102
needless risks195
missed risks301
right safety603
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
League 2: complete letter-readout records are mostly few-option positions, a selected subset.
- Decisions
- 1,978
- Eligible (full probability distribution)
- 509
- Left out, by reason
- asked in groups of options 3; not audited 1,466
- Close choices
- 88.4% (450 / 509)
- Ties in the top two
- 4 decisions (4 at a positive probability, 0 at 0; the two most likely plays tied: 2, the second tied with the third: 2); 4 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 41.6% (187 / 450) of the close choices; 36.7% (187 / 509) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 450 | 0.254median 0.219 | 0.192median 0.164 | 0.446median 0.384 |
| Other decisions | 59 | 0.433median 0.395 | 0.159median 0.141 | 0.592median 0.524 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 6 | 42 | 109 | 79 | 60 | 44 | 37 | 32 | 9 | 32 |
| Other decisions | 0 | 1 | 4 | 12 | 8 | 10 | 5 | 6 | 1 | 12 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 450 | 57.1%257 / 450 | 35.3%159 / 450 | 16.0%72 / 450 | 28.4%128 / 450 | 98 / 170 / 110 / 62 / 10 |
| Other decisions | 59 | 66.1%39 / 59, under 200 decisions | 47.5%28 / 59, under 200 decisions | 18.6%11 / 59, under 200 decisions | 35.6%21 / 59, under 200 decisions | 4 / 22 / 22 / 11 / 0 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 450 | 0.149median 0.073 | 0.081median 0.011 | 0.151median 0.059 |
| Other decisions | 59 | 0.173median 0.135 | 0.029median 0.000 | 0.174median 0.133 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 50.3%80 / 159, under 200 decisions | 60.1%107 / 178, under 200 decisions |
| margin 0.02 | 50.0%71 / 142, under 200 decisions | 59.5%116 / 195, under 200 decisions |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 91.4%159 / 174, under 200 decisions | 85.6%178 / 208 | 89.0%113 / 127, under 200 decisions | 89.5%17 / 19, under 200 decisions | 89.6%43 / 48, under 200 decisions | 92.5%99 / 107, under 200 decisions |
| margin 0.02 | 91.6%142 / 155, under 200 decisions | 85.9%195 / 227 | 89.0%113 / 127, under 200 decisions | N/A0 / 0 | 89.6%43 / 48, under 200 decisions | 92.5%99 / 107, under 200 decisions |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.00189 decisions | 52.9%crude 50.0% (40 / 80), under 200 decisions | 45.1%crude 66.7% (6 / 9), under 200 decisions | +7.8 points95% interval −80.0 to +83.3 | −16.7 points95% interval −52.8 to +21.7 |
| margin 0.0278 decisions | 46.7%crude 46.5% (33 / 71), under 200 decisions | 46.7%crude 71.4% (5 / 7), under 200 decisions | +0.0 points95% interval −100.0 to +85.0 | −24.9 points95% interval −58.6 to +17.0 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 32.1 | 280 |
| Contact | 41.8 | 1,361 |
| Holding game | Too few decisions | 15 |
| Race | 26.7 | 206 |
| Bear-off | Too few decisions | 116 |