decision model · League 1
celeris-1-decision
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- celeris-1-decision
- Provider or endpoint
- Celeris API (probabilities rounded to 2 decimals)
- Date run
- 2026-10-19 to 2026-10-26
- Price
- $0.04 / $0.0 per million tokens in / out; API price; price date 2026-10-10
- Model type
- decision model
- Weights
- Missing
- Runs on
- API
- Reasoning setting
- none (decision model)
- Confidence source
- decision-model probability
- Rules text
- long
- Option groups
- up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; no decision in this data was split
- Sampling settings
- not sent (decision request)
- Notes
- probabilities come rounded to two decimals
Missing B7 fields: weights
Results in League 1
- Error rate (PR)
- 35.632.0 to 39.4
- Decisions
- 1,922 (1,922 scored, 0 invalid)
- Engine's best play
- 45.8%
- Blunder rate
- 25.8%
- P95 equity loss
- 0.339
- Mean loss, worst 5%
- 0.531
- Median / P90 s per decision
- 0.17 / 0.33
- $ per 1,000 decisions
- 0.150API price
- Risk judgement, margin 0.001
- 57.8 (95% interval 55.9 to 59.7); risks found 23.9% (163 / 683), right safety 91.7% (749 / 817)
- Risk judgement, margin 0.02
- 57.3 (95% interval 55.4 to 59.1); risks found 24.1% (141 / 586), right safety 90.5% (827 / 914)
- No trade-off
- 422 (left out of every risk metric)
Risk call card
57.8risk judgement, margin 0.001
right risks163
wrong risks37
needless risks68
missed risks483
right safety749
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
- Decisions
- 1,922
- Eligible (full probability distribution)
- 1,761
- Left out, by reason
- not audited 161
- Close choices
- 29.7% (523 / 1,761)
- Ties in the top two
- 227 decisions (227 at a positive probability, 0 at 0; the two most likely plays tied: 13, the second tied with the third: 215); 25 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 33.7% (176 / 523) of the close choices; 10.0% (176 / 1,761) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 523 | 0.419median 0.420 | 0.301median 0.300 | 0.720median 0.710 |
| Other decisions | 1,238 | 0.775median 0.810 | 0.105median 0.090 | 0.880median 0.920 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 1 | 6 | 9 | 40 | 70 | 111 | 109 | 73 | 104 |
| Other decisions | 0 | 0 | 0 | 1 | 17 | 23 | 57 | 155 | 248 | 737 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 523 | 40.2%210 / 523 | 25.4%133 / 523 | 13.4%70 / 523 | 21.2%111 / 523 | 189 / 194 / 99 / 32 / 9 |
| Other decisions | 1,238 | 56.8%703 / 1,238 | 34.4%426 / 1,238 | 13.7%169 / 1,238 | 29.9%370 / 1,238 | 233 / 521 / 321 / 147 / 16 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 523 | 0.121median 0.056 | 0.082median 0.022 | 0.100median 0.037 |
| Other decisions | 1,238 | 0.144median 0.090 | 0.065median 0.000 | 0.135median 0.072 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 58.8%114 / 194, under 200 decisions | 34.1%62 / 182, under 200 decisions |
| margin 0.02 | 60.5%101 / 167, under 200 decisions | 35.9%75 / 209 |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 31.2%194 / 622 | 24.3%182 / 750 | 37.8%147 / 389 | 29.7%27 / 91, under 200 decisions | 30.3%57 / 188, under 200 decisions | 32.1%110 / 343 |
| margin 0.02 | 31.5%167 / 531 | 24.9%209 / 841 | 37.8%147 / 389 | N/A0 / 0 | 30.3%57 / 188, under 200 decisions | 32.1%110 / 343 |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001417 decisions | 59.8%crude 60.5% (69 / 114), under 200 decisions | 82.7%crude 80.9% (245 / 303) | −22.9 points95% interval −34.7 to −11.0 | −20.3 points95% interval −32.9 to −10.0 |
| margin 0.02362 decisions | 57.7%crude 59.4% (60 / 101), under 200 decisions | 81.8%crude 80.1% (209 / 261) | −24.1 points95% interval −37.6 to −10.6 | −20.7 points95% interval −34.1 to −10.6 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 28.2 | 285 |
| Contact | 41.4 | 1,220 |
| Holding game | Too few decisions | 68 |
| Race | 20.4 | 233 |
| Bear-off | Too few decisions | 116 |