chat model, one letter · League 3

Claude Fable 5.1high

FinishedPublished

Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.

How we called it

Model ID
claude-fable-5-1
Provider or endpoint
Claude subscription
Date run
2026-10-20 to 2026-10-24
Price
$10.0 / $50.0 per million tokens in / out; API-equivalent (subscription); price date not recorded
Model type
chat model, one letter
Weights
closed
Runs on
subscription
Reasoning setting
effort high, the default (adaptive thinking)
Confidence source
none
Rules text
long
Option groups
up to 26 options per request (letters A-Z); more legal plays are split into equal groups, a winner per group, then among the winners; in this data 213 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
Sampling settings
not sent (API default)
Notes
Missing
Earlier name
Claude Fable 5.1 (on) (renamed on 28 Oct 2026 to the reasoning effort its requests sent)

Missing B7 fields: price.date

Results in League 3

Error rate (PR)
14.011.5 to 16.3
Decisions
1,286 (1,286 scored, 0 invalid)
Engine's best play
64.2%
Blunder rate
11.7%
P95 equity loss
0.160
Mean loss, worst 5%
0.266
Median / P90 s per decision
12.7 / 47.1
$ per 1,000 decisions
136.268API-equivalent (subscription)
Risk judgement, margin 0.001
72.3 (95% interval 69.8 to 74.7); risks found 50.7% (215 / 424), right safety 94.0% (529 / 563)
Risk judgement, margin 0.02
72.1 (95% interval 69.5 to 74.9); risks found 52.7% (195 / 370), right safety 91.6% (565 / 617)
No trade-off
299 (left out of every risk metric)

JSON

Risk call card

72.3risk judgement, margin 0.001

right risks215
wrong risks30
needless risks34
missed risks179
right safety529

Hit risk only: being hit. Gammon risk and priming are not in it.

Close choices

A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).

Probabilities over plays, not sampled reasoning. Method

Decisions
1,286
Eligible (full probability distribution)
0
Left out, by reason
one letter only, or a program 1,286
Close choices
N/A no full probability distribution

By game phase

PhaseError rate (PR)Decisions
OpeningToo few decisions176
Contact18.7840
Holding gameToo few decisions74
RaceToo few decisions116
Bear-offToo few decisions80