Setup · League 2

Claude Fable 5.1low

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
Missing
Provider or endpoint
Missing
Date run
2026-10-20 to 2026-10-26
Price
Missing
Model type
Missing
Weights
Missing
Runs on
Missing
Reasoning setting
Missing
Confidence source
Missing
Rules text
Missing
Option groups
not recorded; in this data 232 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
Sampling settings
Missing
Notes
Missing
Earlier name
Claude Fable 5.1 (off) (renamed on 28 Oct 2026 to the reasoning effort its requests sent)
Reasoning, from the logs
Reasoned on 365 of 3,967 decisions.

Missing B7 fields: every B7 field

Results in League 2

Error rate (PR)
17.915.9 to 20.1
Decisions
2,008 (2,008 scored, 0 invalid)
Engine's best play
58.7%
Blunder rate
15.1%
P95 equity loss
0.185
Mean loss, worst 5%
0.313
Median / P90 s per decision
1.54 / 6.34
$ per 1,000 decisions
62.613API-equivalent (subscription)
Risk judgement, margin 0.001
67.8 (95% interval 65.6 to 69.9); risks found 41.0% (270 / 658), right safety 94.6% (781 / 826)
Risk judgement, margin 0.02
68.5 (95% interval 66.3 to 70.8); risks found 43.7% (248 / 567), right safety 93.2% (855 / 917)
No trade-off
524 (left out of every risk metric)

JSON

Risk call card

67.8risk judgement, margin 0.001

right risks270
wrong risks34
needless risks45
missed risks354
right safety781

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

League 2: complete letter-readout records are mostly few-option positions, a selected subset.

Decisions
2,008
Eligible (full probability distribution)
0
Left out, by reason
not audited 197; one letter only, or a program 1,811
Close choices
N/A no full probability distribution

By game phase

PhaseError rate (PR)Decisions
Opening13.9290
Contact22.91,285
Holding gameToo few decisions54
Race5.9216
Bear-offToo few decisions163