decision model · League 1

Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwell

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
NVIDIA RTX PRO 6000 Blackwell (96 GB), bf16
Date run
2026-10-15 to 2026-10-26
Price
no price per token; estimate: GPU time, at most; source content/own_cost.json (wall clock on our machines × hourly rate); price date not recorded
Model type
decision model
Weights
open
Runs on
our GPUs
Reasoning setting
none (decision model)
Confidence source
decision-model probability
Rules text
long
Option groups
up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; no decision in this data was split
Sampling settings
not sent (decision request)
Notes
its server takes no model field; stayed on the same GPU throughout

Results in League 1

Error rate (PR)
65.659.7 to 71.9
Decisions
2,002 (2,002 scored, 0 invalid)
Engine's best play
36.6%
Blunder rate
38.6%
P95 equity loss
0.596
Mean loss, worst 5%
0.846
Median / P90 s per decision
1.57 / 3.38
$ per 1,000 decisions
data-v="7.185">7.185estimate · RTX PRO 6000 Blackwell
Risk judgement, margin 0.001
48.5 (95% interval 46.1 to 50.9); risks found 37.3% (264 / 708), right safety 59.8% (455 / 761)
Risk judgement, margin 0.02
48.0 (95% interval 45.5 to 50.7); risks found 37.7% (236 / 626), right safety 58.4% (492 / 843)
No trade-off
533 (left out of every risk metric)

JSON

Risk call card

48.5risk judgement, margin 0.001

right risks264
wrong risks198
needless risks306
missed risks246
right safety455

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
2,002
Eligible (full probability distribution)
1,776
Left out, by reason
not audited 226
Close choices
98.0% (1,740 / 1,776)
Ties in the top two
0 decisions (0 at a positive probability, 0 at 0; the two most likely plays tied: 0, the second tied with the third: 0); 0 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
Between a safe play and a riskier one
37.4% (651 / 1,740) of the close choices; 36.7% (651 / 1,776) of all eligible decisions
Probabilities of the two most likely plays, mean with median
DecisionsNumberp1 (most likely play)p2 (second)p1 + p2
Close choices1,7400.208median 0.1510.175median 0.1330.383median 0.282
Other decisions360.408median 0.3130.172median 0.1180.579median 0.430
How much probability the two plays hold together: decisions per bin
p1 + p20.0–0.10.1–0.20.2–0.30.3–0.40.4–0.50.5–0.60.6–0.70.7–0.80.8–0.90.9–1.0
Close choices13246332019712515169984181
Other decisions00886100211
What differs between the two most likely plays (several can differ; none is picked as the cause)
DecisionsNumberHitting rollsNewly made pointsPip countsLongest primeNone / 1 / 2 / 3 / 4 differ
Close choices1,74055.3%963 / 1,74035.5%617 / 1,7407.5%131 / 1,74030.9%537 / 1,740366 / 717 / 449 / 199 / 9
Other decisions3641.7%15 / 36, under 200 decisions55.6%20 / 36, under 200 decisions8.3%3 / 36, under 200 decisions50.0%18 / 36, under 200 decisions5 / 12 / 13 / 6 / 0
Engine values (GNUbg 2-ply, equity), mean with median
DecisionsNumberGap between the two plays' valuesMost likely play: behind the engine's bestSecond most likely play: behind the engine's best
Close choices1,7400.147median 0.0800.132median 0.0340.175median 0.086
Other decisions360.147median 0.1330.000median 0.0000.147median 0.133
Close choices between a safe play and a riskier one, by position class
MarginIn Risk pays positionsIn Safety pays positions
margin 0.00144.0%271 / 61656.5%380 / 672
margin 0.0242.4%230 / 54356.5%421 / 745
Close choices among eligible decisions, by position class and stake band
MarginRisk paysSafety paysNo trade-offRisk pays, small stakeRisk pays, medium stakeRisk pays, big stake
margin 0.00199.0%616 / 62297.5%672 / 68997.2%452 / 46598.6%73 / 74, under 200 decisions98.5%200 / 20399.4%343 / 345
margin 0.0299.1%543 / 54897.6%745 / 76397.2%452 / 465N/A0 / 098.5%200 / 20399.4%343 / 345

At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.

Missed risks where the risk is worth taking, close choices vs other decisions
MarginClose choices: missed risksOther decisions: missed risks (weighted to the close choices' mix)Difference, close minus otherCrude difference
margin 0.001271 decisionsN/A57.2% (155 / 271)N/AN/A (0 / 0)N/A: no other decisions in this groupN/A
margin 0.02230 decisionsN/A56.5% (130 / 230)N/AN/A (0 / 0)N/A: no other decisions in this groupN/A

By game phase

PhaseError rate (PR)Decisions
Opening35.4296
Contact87.41,217
Holding gameToo few decisions47
Race29.5312
Bear-offToo few decisions130