decision model · League 1
Mercury Decide
FinishedPublished
Results f24d1f41, updated 16 November 2026, 21:24 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- inception/mercury-decide
- Provider or endpoint
- OpenRouter (Inception)
- Date run
- 2026-10-20 to 2026-10-26
- Price
- $0.02 / $0.0 per million tokens in / out; API price; price date 2026-10-17
- Model type
- decision model
- Weights
- Missing
- Runs on
- API
- Reasoning setting
- none (decision model)
- Confidence source
- decision-model probability
- Rules text
- long
- Option groups
- up to 255 options per request; more legal plays are split into equal groups, a winner per group, then among the winners; no decision in this data was split
- Sampling settings
- not sent (decision request)
- Notes
- Inception's Mercury Decide through OpenRouter's decision route, paid listing; latency includes OpenRouter's own time
Missing B7 fields: weights
Results in League 1
- Error rate (PR)
- 47.943.3 to 52.9
- Decisions
- 1,853 (1,853 scored, 0 invalid)
- Engine's best play
- 42.2%
- Blunder rate
- 30.3%
- P95 equity loss
- 0.481
- Mean loss, worst 5%
- 0.728
- Median / P90 s per decision
- 0.48 / 0.77
- $ per 1,000 decisions
- 0.071API price
- Risk judgement, margin 0.001
- 53.4 (95% interval 51.5 to 55.2); risks found 18.7% (129 / 690), right safety 88.1% (583 / 662)
- Risk judgement, margin 0.02
- 53.1 (95% interval 51.3 to 55.1); risks found 18.4% (115 / 625), right safety 87.8% (638 / 727)
- No trade-off
- 501 (left out of every risk metric)
Risk call card
53.4risk judgement, margin 0.001
right risks129
wrong risks44
needless risks79
missed risks517
right safety583
Hit risk only: being hit. Gammon risk and priming are not in it.
Close choices
A decision is a close choice when the second most likely play has at least half the probability of the first (internally: split).
Probabilities over plays, not sampled reasoning. Method
- Decisions
- 1,853
- Eligible (full probability distribution)
- 1,629
- Left out, by reason
- not audited 224
- Close choices
- 16.1% (262 / 1,629)
- Ties in the top two
- 84 decisions (84 at a positive probability, 0 at 0; the two most likely plays tied: 28, the second tied with the third: 57); 38 of them close choices. Ties are broken by the order the plays were shown, never by the engine.
- Between a safe play and a riskier one
- 29.0% (76 / 262) of the close choices; 4.7% (76 / 1,629) of all eligible decisions
| Decisions | Number | p1 (most likely play) | p2 (second) | p1 + p2 |
|---|---|---|---|---|
| Close choices | 262 | 0.490median 0.506 | 0.346median 0.349 | 0.837median 0.881 |
| Other decisions | 1,367 | 0.887median 0.941 | 0.074median 0.037 | 0.961median 0.989 |
| p1 + p2 | 0.0–0.1 | 0.1–0.2 | 0.2–0.3 | 0.3–0.4 | 0.4–0.5 | 0.5–0.6 | 0.6–0.7 | 0.7–0.8 | 0.8–0.9 | 0.9–1.0 |
|---|---|---|---|---|---|---|---|---|---|---|
| Close choices | 0 | 0 | 0 | 2 | 9 | 20 | 16 | 46 | 45 | 124 |
| Other decisions | 0 | 0 | 0 | 0 | 0 | 6 | 17 | 39 | 105 | 1,200 |
| Decisions | Number | Hitting rolls | Newly made points | Pip counts | Longest prime | None / 1 / 2 / 3 / 4 differ |
|---|---|---|---|---|---|---|
| Close choices | 262 | 31.3%82 / 262 | 27.5%72 / 262 | 8.4%22 / 262 | 26.7%70 / 262 | 116 / 74 / 48 / 20 / 4 |
| Other decisions | 1,367 | 50.5%691 / 1,367 | 33.0%451 / 1,367 | 10.9%149 / 1,367 | 29.7%406 / 1,367 | 299 / 592 / 336 / 127 / 13 |
| Decisions | Number | Gap between the two plays' values | Most likely play: behind the engine's best | Second most likely play: behind the engine's best |
|---|---|---|---|---|
| Close choices | 262 | 0.104median 0.050 | 0.131median 0.044 | 0.138median 0.046 |
| Other decisions | 1,367 | 0.135median 0.072 | 0.092median 0.011 | 0.159median 0.078 |
| Margin | In Risk pays positions | In Safety pays positions |
|---|---|---|
| margin 0.001 | 61.0%61 / 100, under 200 decisions | 18.8%15 / 80, under 200 decisions |
| margin 0.02 | 64.4%58 / 90, under 200 decisions | 20.0%18 / 90, under 200 decisions |
| Margin | Risk pays | Safety pays | No trade-off | Risk pays, small stake | Risk pays, medium stake | Risk pays, big stake |
|---|---|---|---|---|---|---|
| margin 0.001 | 16.4%100 / 610 | 14.1%80 / 566 | 18.1%82 / 453 | 18.2%10 / 55, under 200 decisions | 18.6%34 / 183, under 200 decisions | 15.1%56 / 372 |
| margin 0.02 | 16.2%90 / 555 | 14.5%90 / 621 | 18.1%82 / 453 | N/A0 / 0 | 18.6%34 / 183, under 200 decisions | 15.1%56 / 372 |
At the 0.02 margin a Risk pays position has a stake of at least 0.02, so the small band is empty. A big stake means playing safe costs more by the engine's value, not that the decision was harder.
| Margin | Close choices: missed risks | Other decisions: missed risks (weighted to the close choices' mix) | Difference, close minus other | Crude difference |
|---|---|---|---|---|
| margin 0.001412 decisions | 55.0%crude 54.1% (33 / 61), under 200 decisions | 75.2%crude 79.2% (278 / 351) | −20.2 points95% interval −31.9 to −8.6 | −25.1 points95% interval −37.0 to −13.1 |
| margin 0.02384 decisions | 54.4%crude 53.4% (31 / 58), under 200 decisions | 74.7%crude 78.8% (257 / 326) | −20.3 points95% interval −32.3 to −8.0 | −25.4 points95% interval −37.1 to −13.6 |
By game phase
| Phase | Error rate (PR) | Decisions |
|---|---|---|
| Opening | 44.6 | 288 |
| Contact | 56.9 | 1,188 |
| Holding game | Too few decisions | 30 |
| Race | 24.0 | 247 |
| Bear-off | Too few decisions | 100 |