Setup · League 2
Claude Fable 5.1low
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- Missing
- Provider or endpoint
- Missing
- Date run
- 2026-10-20 to 2026-10-26
- Price
- Missing
- Model type
- Missing
- Weights
- Missing
- Runs on
- Missing
- Reasoning setting
- Missing
- Confidence source
- Missing
- Rules text
- Missing
- Option groups
- not recorded; in this data 232 decisions were split into groups of 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26
- Sampling settings
- Missing
- Notes
- Missing
- Earlier name
- Claude Fable 5.1 (off) (renamed on 28 Oct 2026 to the reasoning effort its requests sent)
- Reasoning, from the logs
- Reasoned on 365 of 3,967 decisions.
Missing B7 fields: every B7 field
Results in League 2
- Error rate (PR)
- 17.915.9 to 20.1
- Decisions
- 2,008 (2,008 scored, 0 invalid)
- Engine's best play
- 58.7%
- Blunder rate
- 15.1%
- P95 equity loss
- 0.185
- Mean loss, worst 5%
- 0.313
- Median / P90 s per decision
- 1.54 / 6.34
- $ per 1,000 decisions
- 62.613API-equivalent (subscription)
- Risk judgement, margin 0.001
- 67.8 (95% interval 65.6 to 69.9); risks found 41.0% (270 / 658), right safety 94.6% (781 / 826)
- Risk judgement, margin 0.02
- 68.5 (95% interval 66.3 to 70.8); risks found 43.7% (248 / 567), right safety 93.2% (855 / 917)
- No trade-off
- 524 (left out of every risk metric)
Risk call card
67.8risk judgement, margin 0.001
right risks270
wrong risks34
needless risks45
missed risks354
right safety781
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
League 2: complete letter-readout records are mostly few-option positions, a selected subset.
- Decisions
- 2,008
- Eligible (full probability distribution)
- 0
- Left out, by reason
- not audited 197; one letter only, or a program 1,811
- Close choices
- N/A no full probability distribution
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 13.9 | 290 |
| Contact | 22.9 | 1,285 |
| Holding game | Too few decisions | 54 |
| Race | 5.9 | 216 |
| Bear-off | Too few decisions | 163 |