decision model · League 1

Jev 1.13

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
jev-1.13.0
Provider or endpoint
TypeSafe API
Date run
2026-10-19 to 2026-10-26
Price
$0.042 / $0.0 per million tokens in / out; API price; price date 2026-10-08
Model type
decision model
Weights
Missing
Runs on
API
Reasoning setting
none (decision model)
Confidence source
decision-model probability
Rules text
long
Option groups
up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; no decision in this data was split
Sampling settings
not sent (decision request)
Notes
TypeSafe System One API

Missing B7 fields: weights

Results in League 1

Error rate (PR)
34.431.0 to 38.0
Decisions
1,911 (1,911 scored, 0 invalid)
Engine's best play
50.7%
Blunder rate
25.1%
P95 equity loss
0.352
Mean loss, worst 5%
0.534
Median / P90 s per decision
0.22 / 0.26
$ per 1,000 decisions
0.166API price
Risk judgement, margin 0.001
59.5 (95% interval 57.4 to 61.6); risks found 27.0% (190 / 705), right safety 92.1% (710 / 771)
Risk judgement, margin 0.02
58.4 (95% interval 56.2 to 60.8); risks found 26.8% (167 / 622), right safety 90.0% (769 / 854)
No trade-off
435 (left out of every risk metric)

JSON

Risk call card

59.5risk judgement, margin 0.001

right risks190
wrong risks57
needless risks61
missed risks458
right safety710

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
1,911
Eligible (full probability distribution)
1,687
Left out, by reason
not audited 224
Close choices
42.3% (713 / 1,687)
Ties in the top two
108 decisions (106 at a positive probability, 2 at 0; the two most likely plays tied: 22, the second tied with the third: 86); 44 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
42.2% (301 / 713) of the close choices; 17.8% (301 / 1,687) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices7130.397median 0.3900.284median 0.2700.681median 0.680
Other decisions9740.681median 0.6870.148median 0.1500.829median 0.850
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices006308712913613283110
Other decisions00001051121179238375
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices71350.8%362 / 71332.1%229 / 71313.3%95 / 71327.6%197 / 713201 / 268 / 136 / 89 / 19
Other decisions97456.9%554 / 97438.8%378 / 97412.1%118 / 97432.4%316 / 974176 / 391 / 261 / 131 / 15
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices7130.113median 0.0570.093median 0.0180.105median 0.046
Other decisions9740.154median 0.0950.052median 0.0000.152median 0.090
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00163.7%209 / 32842.0%92 / 219
margin 0.0263.9%186 / 29144.9%115 / 256
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00152.7%328 / 62232.0%219 / 68543.7%166 / 38052.9%37 / 70, under 200 decisions50.0%84 / 168, under 200 decisions53.9%207 / 384
margin 0.0252.7%291 / 55233.9%256 / 75543.7%166 / 380N/A0 / 050.0%84 / 168, under 200 decisions53.9%207 / 384

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001423 decisions56.8%crude 57.4% (120 / 209)79.8%crude 79.9% (171 / 214)−23.0 points95% interval −29.9 to −15.8−22.5 points95% interval −29.9 to −14.6
margin 0.02379 decisions56.3%crude 57.0% (106 / 186), under 200 decisions78.9%crude 78.2% (151 / 193), under 200 decisions−22.6 points95% interval −31.4 to −13.9−21.2 points95% interval −29.3 to −12.6

By game phase

PhaseError rate (PR)Decisions
Opening35.0279
Contact40.41,281
Holding gameToo few decisions38
Race11.1227
Bear-offToo few decisions86