decision model · League 1

celeris-1-decision

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
celeris-1-decision
Provider or endpoint
Celeris API (probabilities rounded to 2 decimals)
Date run
2026-10-19 to 2026-10-26
Price
$0.04 / $0.0 per million tokens in / out; API price; price date 2026-10-10
Model type
decision model
Weights
Missing
Runs on
API
Reasoning setting
none (decision model)
Confidence source
decision-model probability
Rules text
long
Option groups
up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; no decision in this data was split
Sampling settings
not sent (decision request)
Notes
probabilities come rounded to two decimals

Missing B7 fields: weights

Results in League 1

Error rate (PR)
35.632.0 to 39.4
Decisions
1,922 (1,922 scored, 0 invalid)
Engine's best play
45.8%
Blunder rate
25.8%
P95 equity loss
0.339
Mean loss, worst 5%
0.531
Median / P90 s per decision
0.17 / 0.33
$ per 1,000 decisions
0.150API price
Risk judgement, margin 0.001
57.8 (95% interval 55.9 to 59.7); risks found 23.9% (163 / 683), right safety 91.7% (749 / 817)
Risk judgement, margin 0.02
57.3 (95% interval 55.4 to 59.1); risks found 24.1% (141 / 586), right safety 90.5% (827 / 914)
No trade-off
422 (left out of every risk metric)

JSON

Risk call card

57.8risk judgement, margin 0.001

right risks163
wrong risks37
needless risks68
missed risks483
right safety749

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
1,922
Eligible (full probability distribution)
1,761
Left out, by reason
not audited 161
Close choices
29.7% (523 / 1,761)
Ties in the top two
227 decisions (227 at a positive probability, 0 at 0; the two most likely plays tied: 13, the second tied with the third: 215); 25 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
33.7% (176 / 523) of the close choices; 10.0% (176 / 1,761) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices5230.419median 0.4200.301median 0.3000.720median 0.710
Other decisions1,2380.775median 0.8100.105median 0.0900.880median 0.920
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices0169407011110973104
Other decisions0001172357155248737
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices52340.2%210 / 52325.4%133 / 52313.4%70 / 52321.2%111 / 523189 / 194 / 99 / 32 / 9
Other decisions1,23856.8%703 / 1,23834.4%426 / 1,23813.7%169 / 1,23829.9%370 / 1,238233 / 521 / 321 / 147 / 16
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices5230.121median 0.0560.082median 0.0220.100median 0.037
Other decisions1,2380.144median 0.0900.065median 0.0000.135median 0.072
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00158.8%114 / 194, under 200 decisions34.1%62 / 182, under 200 decisions
margin 0.0260.5%101 / 167, under 200 decisions35.9%75 / 209
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00131.2%194 / 62224.3%182 / 75037.8%147 / 38929.7%27 / 91, under 200 decisions30.3%57 / 188, under 200 decisions32.1%110 / 343
margin 0.0231.5%167 / 53124.9%209 / 84137.8%147 / 389N/A0 / 030.3%57 / 188, under 200 decisions32.1%110 / 343

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001417 decisions59.8%crude 60.5% (69 / 114), under 200 decisions82.7%crude 80.9% (245 / 303)−22.9 points95% interval −34.7 to −11.0−20.3 points95% interval −32.9 to −10.0
margin 0.02362 decisions57.7%crude 59.4% (60 / 101), under 200 decisions81.8%crude 80.1% (209 / 261)−24.1 points95% interval −37.6 to −10.6−20.7 points95% interval −34.1 to −10.6

By game phase

PhaseError rate (PR)Decisions
Opening28.2285
Contact41.41,220
Holding gameToo few decisions68
Race20.4233
Bear-offToo few decisions116