Setup · League 1
LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-19 to 2026-10-25
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 229 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
- Sampling settings
- Missing
- Notes
- Missing
Missing B7 fields: every B7 field
Results in League 1
- Error rate (PR)
- 47.744.1 to 51.2
- Decisions
- 2,193 (2,193 scored, 0 invalid)
- Engine's best play
- 39.6%
- Blunder rate
- 32.4%
- P95 equity loss
- 0.431
- Mean loss, worst 5%
- 0.631
- Median / P90 s per decision
- 324.8 / 668.6
- $ per 1,000 decisions
- data-v="38.716">38.716estimate · RTX PRO 6000 Blackwell
- Risk judgement, margin 0.001
- 52.4 (95% interval 50.3 to 54.5); risks found 31.5% (248 / 788), right safety 73.4% (647 / 882)
- Risk judgement, margin 0.02
- 52.4 (95% interval 50.2 to 54.6); risks found 32.2% (224 / 695), right safety 72.6% (708 / 975)
- No trade-off
- 523 (left out of every risk metric)
Risk call card
52.4risk judgement, margin 0.001
right risks248
wrong risks167
needless risks235
missed risks373
right safety647
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
- Decisions
- 2,193
- Eligible (full probability distribution)
- 151
- Left out, by reason
- asked in groups of options 229; incomplete distribution (an option without its own probability) 1,770; not audited 43
- Close choices
- 0.0% (0 / 151), under 200 decisions
- Ties in the top two
- 1 decisions (1 at a positive probability, 0 at 0; the two most likely plays tied: 0, the second tied with the third: 1); 0 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- N/A (0 / 0) of the close choices; 0.0% (0 / 151), under 200 decisions of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 0 | N/A | N/A | N/A |
| Other decisions | 151 | 0.991median 1.000 | 0.004median 0.000 | 0.995median 1.000 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Other decisions | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 149 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 0 | N/A0 / 0 | N/A0 / 0 | N/A0 / 0 | N/A0 / 0 | 0 / 0 / 0 / 0 / 0 |
| Other decisions | 151 | 35.8%54 / 151, under 200 decisions | 7.3%11 / 151, under 200 decisions | 18.5%28 / 151, under 200 decisions | 24.5%37 / 151, under 200 decisions | 46 / 80 / 25 / 0 / 0 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 0 | N/A | N/A | N/A |
| Other decisions | 151 | 0.101median 0.023 | 0.037median 0.000 | 0.083median 0.003 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | N/A0 / 0 | N/A0 / 0 |
| margin 0.02 | N/A0 / 0 | N/A0 / 0 |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 0.0%0 / 16, under 200 decisions | 0.0%0 / 41, under 200 decisions | 0.0%0 / 94, under 200 decisions | 0.0%0 / 3, under 200 decisions | 0.0%0 / 10, under 200 decisions | 0.0%0 / 3, under 200 decisions |
| margin 0.02 | 0.0%0 / 13, under 200 decisions | 0.0%0 / 44, under 200 decisions | 0.0%0 / 94, under 200 decisions | N/A0 / 0 | 0.0%0 / 10, under 200 decisions | 0.0%0 / 3, under 200 decisions |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.00113 decisions | N/AN/A (0 / 0) | 76.9%76.9% (10 / 13), under 200 decisions | N/A: no close choices in this group | N/A |
| margin 0.0210 decisions | N/AN/A (0 / 0) | 70.0%70.0% (7 / 10), under 200 decisions | N/A: no close choices in this group | N/A |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 42.1 | 297 |
| Contact | 56.0 | 1,436 |
| Holding game | Too few decisions | 55 |
| Race | 16.2 | 281 |
| Bear-off | Too few decisions | 124 |