Setup · League 1
LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-19 to 2026-10-23
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 182 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
- Sampling settings
- Missing
- Notes
- Missing
Missing B7 fields: every B7 field
Results in League 1
- Error rate (PR)
- 61.556.3 to 66.8
- Decisions
- 1,952 (1,952 scored, 0 invalid)
- Engine's best play
- 32.2%
- Blunder rate
- 40.8%
- P95 equity loss
- 0.521
- Mean loss, worst 5%
- 0.744
- Median / P90 s per decision
- 0.14 / 0.36
- $ per 1,000 decisions
- data-v="9.132">9.132estimate · RTX PRO 6000 Blackwell
- Risk judgement, margin 0.001
- 45.7 (95% interval 43.2 to 48.1); risks found 28.8% (206 / 715), right safety 62.7% (470 / 750)
- Risk judgement, margin 0.02
- 44.9 (95% interval 42.6 to 47.6); risks found 28.4% (181 / 637), right safety 61.5% (509 / 828)
- No trade-off
- 487 (left out of every risk metric)
Risk call card
45.7risk judgement, margin 0.001
right risks206
wrong risks162
needless risks280
missed risks347
right safety470
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
- Decisions
- 1,952
- Eligible (full probability distribution)
- 1,509
- Left out, by reason
- asked in groups of options 182; incomplete distribution (an option without its own probability) 261
- Close choices
- 58.6% (884 / 1,509)
- Ties in the top two
- 284 decisions (284 at a positive probability, 0 at 0; the two most likely plays tied: 120, the second tied with the third: 174); 225 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 41.3% (365 / 884) of the close choices; 24.2% (365 / 1,509) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 884 | 0.314median 0.287 | 0.233median 0.219 | 0.546median 0.506 |
| Other decisions | 625 | 0.609median 0.587 | 0.156median 0.156 | 0.765median 0.741 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 0 | 8 | 101 | 315 | 225 | 100 | 39 | 57 | 39 |
| Other decisions | 0 | 0 | 0 | 10 | 43 | 101 | 121 | 71 | 55 | 224 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 884 | 61.1%540 / 884 | 28.2%249 / 884 | 12.8%113 / 884 | 23.2%205 / 884 | 180 / 401 / 214 / 78 / 11 |
| Other decisions | 625 | 58.7%367 / 625 | 29.3%183 / 625 | 15.0%94 / 625 | 25.8%161 / 625 | 116 / 272 / 182 / 51 / 4 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 884 | 0.146median 0.083 | 0.131median 0.055 | 0.139median 0.067 |
| Other decisions | 625 | 0.156median 0.082 | 0.072median 0.002 | 0.141median 0.065 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 58.0%195 / 336 | 51.7%170 / 329 |
| margin 0.02 | 57.8%167 / 289 | 52.7%198 / 376 |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 65.6%336 / 512 | 57.5%329 / 572 | 51.5%219 / 425 | 75.8%47 / 62, under 200 decisions | 56.2%90 / 160, under 200 decisions | 68.6%199 / 290 |
| margin 0.02 | 64.2%289 / 450 | 59.3%376 / 634 | 51.5%219 / 425 | N/A0 / 0 | 56.2%90 / 160, under 200 decisions | 68.6%199 / 290 |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001334 decisions | 58.9%crude 59.0% (115 / 195), under 200 decisions | 82.4%crude 80.6% (112 / 139), under 200 decisions | −23.5 points95% interval −33.7 to −13.8 | −21.6 points95% interval −30.4 to −11.8 |
| margin 0.02294 decisions | 58.8%crude 58.7% (98 / 167), under 200 decisions | 82.7%crude 81.1% (103 / 127), under 200 decisions | −23.9 points95% interval −33.5 to −13.9 | −22.4 points95% interval −30.3 to −14.5 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 56.0 | 282 |
| Contact | 73.3 | 1,254 |
| Holding game | Too few decisions | 44 |
| Race | 26.5 | 268 |
| Bear-off | Too few decisions | 104 |