Phases
Where do models fail?
Results f24d1f41, updated 16 November 2026, 22:20 UTC; scored by GNU Backgammon 1.08, 2-ply.
League 1
FinishedPublishedRisk judgement per phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| GNUbg weakprogram · CPU | 57.3219 with a trade-off | 69.11,174 with a trade-off | 75.011 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Jev 1.13decision model · API | 66.1278 with a trade-off | 57.51,166 with a trade-off | 60.332 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GLiDEv1.2 · NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 71.1285 with a trade-off | 55.11,130 with a trade-off | 52.574 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| DeepSeek-V4.1-Flashoff · API + NVIDIA RTX PRO 6000 Blackwell · first release | 63.0255 with a trade-off | 58.51,055 with a trade-off | 46.923 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| celeris-1-decisiondecision model · API | 66.3283 with a trade-off | 55.41,156 with a trade-off | 56.161 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Perplexity Decider 27B v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 72.2286 with a trade-off | 54.01,230 with a trade-off | 51.042 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| CygnetNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 61.8298 with a trade-off | 55.91,203 with a trade-off | 65.338 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Perplexity Decider 27B v1.1NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 63.6302 with a trade-off | 54.01,181 with a trade-off | 56.465 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GPT-6 LunaDecisions APIdecision model · API | 58.1293 with a trade-off | 55.01,129 with a trade-off | 60.027 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| SubQ Snap Previewdecision model · API | 68.4305 with a trade-off | 52.71,301 with a trade-off | 50.573 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 65.3310 with a trade-off | 55.11,154 with a trade-off | 66.724 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 59.1296 with a trade-off | 51.31,321 with a trade-off | 44.853 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Mercury Decidedecision model · API | 60.4288 with a trade-off | 51.51,036 with a trade-off | 43.828 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Winnow-12BNVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 66.5298 with a trade-off | 52.61,175 with a trade-off | 41.655 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Safestprogram · CPU | 50.0317 with a trade-off | 50.01,202 with a trade-off | 50.015 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Perplexity Decider Flash v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 54.1290 with a trade-off | 48.41,175 with a trade-off | 40.723 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell | 49.1282 with a trade-off | 44.61,147 with a trade-off | 51.936 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 65.8295 with a trade-off | 42.91,130 with a trade-off | 52.544 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Randomprogram · CPU | 19.1181 with a trade-off | 26.1735 with a trade-off | 22.720 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
Hit risk only: being hit. Gammon risk and priming are not in it.
Game phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| GNUbg weakprogram · CPU | 35.2221 | 22.81,254 | Too few decisions14 | Too few decisions184 | Too few decisions71 |
| Jev 1.13decision model · API | 35.0279 | 40.41,281 | Too few decisions38 | 11.1227 | Too few decisions86 |
| GLiDEv1.2 · NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 25.6288 | 44.11,220 | Too few decisions83 | 14.8286 | Too few decisions126 |
| DeepSeek-V4.1-Flashoff · API + NVIDIA RTX PRO 6000 Blackwell · first release | 33.8255 | 43.41,141 | Too few decisions29 | Too few decisions179 | Too few decisions132 |
| celeris-1-decisiondecision model · API | 28.2285 | 41.41,220 | Too few decisions68 | 20.4233 | Too few decisions116 |
| Perplexity Decider 27B v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 26.1287 | 46.11,304 | Too few decisions47 | 18.5274 | Too few decisions116 |
| CygnetNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 39.1298 | 44.31,302 | Too few decisions44 | 22.0246 | Too few decisions126 |
| Perplexity Decider 27B v1.1NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 38.0304 | 46.11,277 | Too few decisions75 | 20.8251 | Too few decisions145 |
| GPT-6 LunaDecisions APIdecision model · API | 40.1293 | 50.91,272 | Too few decisions30 | 19.0231 | Too few decisions136 |
| SubQ Snap Previewdecision model · API | 35.0307 | 53.61,375 | Too few decisions82 | 20.8295 | Too few decisions141 |
| Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 35.7310 | 57.21,259 | Too few decisions28 | 18.3273 | Too few decisions135 |
| LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 42.1297 | 56.01,436 | Too few decisions55 | 16.2281 | Too few decisions124 |
| Mercury Decidedecision model · API | 44.6288 | 56.91,188 | Too few decisions30 | 24.0247 | Too few decisions100 |
| Winnow-12BNVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 37.8298 | 61.01,283 | Too few decisions67 | 20.2265 | Too few decisions102 |
| Safestprogram · CPU | 53.8317 | 54.51,341 | Too few decisions17 | 34.6248 | Too few decisions135 |
| Perplexity Decider Flash v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 50.9291 | 71.11,283 | Too few decisions25 | 34.3283 | Too few decisions124 |
| LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell | 56.0282 | 73.31,254 | Too few decisions44 | 26.5268 | Too few decisions104 |
| Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 35.4296 | 87.41,217 | Too few decisions47 | 29.5312 | Too few decisions130 |
| Randomprogram · CPU | Too few decisions183 | 148.5836 | Too few decisions22 | 43.6257 | Too few decisions39 |
Strategy tag (contact and holding positions after the opening)
Swipe for more columns →
| Model and setting | Blitz | Back game | Holding game | Priming | Low-anchor | Other |
|---|---|---|---|---|---|---|
| GNUbg weakprogram · CPU | 17.3474 | Too few decisions115 | Too few decisions14 | 27.3258 | 24.8253 | Too few decisions154 |
| Jev 1.13decision model · API | 31.6255 | Too few decisions60 | Too few decisions38 | 40.1379 | 47.9481 | Too few decisions106 |
| GLiDEv1.2 · NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 40.1225 | Too few decisions23 | Too few decisions83 | 39.7399 | 49.0343 | 48.6230 |
| DeepSeek-V4.1-Flashoff · API + NVIDIA RTX PRO 6000 Blackwell · first release | 26.6245 | Too few decisions16 | Too few decisions29 | 49.0408 | 54.0370 | Too few decisions102 |
| celeris-1-decisiondecision model · API | 28.1213 | Too few decisions29 | Too few decisions68 | 35.1335 | 51.6471 | Too few decisions172 |
| Perplexity Decider 27B v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 42.5308 | Too few decisions23 | Too few decisions47 | 47.7359 | 49.5396 | 42.7218 |
| CygnetNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 40.2230 | Too few decisions44 | Too few decisions44 | 40.6382 | 54.7498 | Too few decisions148 |
| Perplexity Decider 27B v1.1NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 52.6227 | Too few decisions16 | Too few decisions75 | 44.2455 | 46.1397 | Too few decisions182 |
| GPT-6 LunaDecisions APIdecision model · API | Too few decisions184 | Too few decisions11 | Too few decisions30 | 46.7456 | 60.8517 | Too few decisions104 |
| SubQ Snap Previewdecision model · API | 42.8298 | Too few decisions37 | Too few decisions82 | 52.7405 | 54.0428 | 76.0207 |
| Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | Too few decisions199 | Too few decisions5 | Too few decisions28 | 54.2423 | 69.8517 | Too few decisions115 |
| LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 49.8302 | Too few decisions117 | Too few decisions55 | 51.4338 | 65.5445 | 55.4234 |
| Mercury Decidedecision model · API | Too few decisions142 | Too few decisions11 | Too few decisions30 | 53.8475 | 62.4477 | Too few decisions83 |
| Winnow-12BNVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 49.7244 | Too few decisions27 | Too few decisions67 | 62.7363 | 60.3455 | Too few decisions194 |
| Safestprogram · CPU | Too few decisions165 | Too few decisions14 | Too few decisions17 | 38.4316 | 70.3691 | Too few decisions155 |
| Perplexity Decider Flash v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 54.7238 | Too few decisions44 | Too few decisions25 | 66.9343 | 75.5458 | 87.5200 |
| LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell | 66.7230 | Too few decisions87 | Too few decisions44 | 62.6279 | 75.5437 | 92.6221 |
| Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | Too few decisions186 | Too few decisions11 | Too few decisions47 | 97.6286 | 81.9506 | 101.1228 |
| Randomprogram · CPU | 120.5228 | Too few decisions65 | Too few decisions22 | Too few decisions94 | 148.8272 | Too few decisions177 |
Number of legal plays
Swipe for more columns →
| Model and setting | 2–5 | 6–10 | 11–15 | 16–25 | 26+ |
|---|---|---|---|---|---|
| GNUbg weakprogram · CPU | 9.5452 | 17.6320 | 23.2249 | 30.7358 | 29.1365 |
| Jev 1.13decision model · API | 15.2665 | 41.7407 | 40.7328 | 45.9340 | Too few decisions171 |
| GLiDEv1.2 · NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 12.6582 | 32.6475 | 43.1332 | 43.7366 | 68.4248 |
| DeepSeek-V4.1-Flashoff · API + NVIDIA RTX PRO 6000 Blackwell · first release | 11.5548 | 43.3402 | 50.4311 | 43.8313 | Too few decisions162 |
| celeris-1-decisiondecision model · API | 17.0601 | 33.9458 | 38.5290 | 45.4360 | 71.6213 |
| Perplexity Decider 27B v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 20.5676 | 34.5500 | 41.9298 | 47.7348 | 71.2206 |
| CygnetNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 21.4719 | 42.4481 | 49.2351 | 47.5334 | Too few decisions131 |
| Perplexity Decider 27B v1.1NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 19.5634 | 36.9477 | 54.9333 | 45.0382 | 62.6226 |
| GPT-6 LunaDecisions APIdecision model · API | 19.6695 | 55.5451 | 52.9345 | 54.8311 | Too few decisions160 |
| SubQ Snap Previewdecision model · API | 15.4644 | 43.1469 | 48.4383 | 56.6415 | 84.2289 |
| Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 22.5704 | 53.7449 | 51.2310 | 62.5351 | Too few decisions191 |
| LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 26.2663 | 45.6459 | 56.2378 | 62.3448 | 69.8245 |
| Mercury Decidedecision model · API | 26.7655 | 44.2457 | 61.3308 | 67.0294 | Too few decisions139 |
| Winnow-12BNVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 28.5642 | 52.6464 | 55.0352 | 66.0343 | 72.6214 |
| Safestprogram · CPU | 29.1782 | 51.9569 | 65.4347 | 75.6230 | Too few decisions130 |
| Perplexity Decider Flash v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 28.1610 | 54.7477 | 70.5337 | 79.7358 | 107.4224 |
| LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell | 42.8602 | 54.9465 | 63.6338 | 75.0347 | 105.6200 |
| Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 33.0673 | 66.7444 | 66.4311 | 85.7349 | 128.4225 |
| Randomprogram · CPU | 60.2278 | 116.0238 | 123.2209 | 132.8307 | 167.4305 |
Equity gap between the two best plays
Swipe for more columns →
| Model and setting | Under 0.02 | 0.02 to 0.08 | Over 0.08 |
|---|---|---|---|
| GNUbg weakprogram · CPU | 14.8738 | 25.4547 | 27.3459 |
| Jev 1.13decision model · API | 20.2702 | 35.9599 | 49.4610 |
| GLiDEv1.2 · NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 21.8860 | 40.1590 | 50.0553 |
| DeepSeek-V4.1-Flashoff · API + NVIDIA RTX PRO 6000 Blackwell · first release | 22.1643 | 37.5546 | 49.5547 |
| celeris-1-decisiondecision model · API | 19.4695 | 39.3614 | 50.5613 |
| Perplexity Decider 27B v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 24.6742 | 39.5634 | 48.5652 |
| CygnetNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 25.0743 | 37.9656 | 55.5617 |
| Perplexity Decider 27B v1.1NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkdecision model · our GPUs | 22.9755 | 37.5646 | 58.5651 |
| GPT-6 LunaDecisions APIdecision model · API | 24.9733 | 47.6618 | 61.0611 |
| SubQ Snap Previewdecision model · API | 28.8863 | 41.4689 | 66.5648 |
| Qwen3.8-27Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 29.0754 | 43.7624 | 65.7627 |
| LFM2.5-24B-A2Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 31.6852 | 50.1736 | 67.4605 |
| Mercury Decidedecision model · API | 25.0711 | 46.3578 | 78.5564 |
| Winnow-12BNVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 26.3799 | 52.6625 | 78.4591 |
| Safestprogram · CPU | 32.2762 | 43.7649 | 82.6647 |
| Perplexity Decider Flash v1.2NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 39.6782 | 58.7603 | 85.7621 |
| LFM2.5-24B-A2Boff · NVIDIA RTX PRO 6000 Blackwell | 35.4771 | 61.0619 | 97.7562 |
| Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwelldecision model · our GPUs | 41.1829 | 66.9606 | 99.9567 |
| Randomprogram · CPU | 59.4546 | 126.0395 | 201.3396 |
League 2
FinishedPublishedRisk judgement per phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| Gemini 3.8 Flashhighchat model, one letter · subscription | 80.5307 with a trade-off | 61.61,251 with a trade-off | 65.552 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Gemini 3.8 Flashlowchat model, one letter · subscription | 76.6300 with a trade-off | 60.21,171 with a trade-off | 62.471 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Sonnet 5.5highchat model, one letter · subscription | 77.3299 with a trade-off | 65.01,281 with a trade-off | 70.846 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| DeepSeek-V4.1-Flashlow · API · 1017chat model, answer-letter probabilities · API | 80.8318 with a trade-off | 64.31,300 with a trade-off | 65.660 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Fable 5.1low | 78.3289 with a trade-off | 63.91,156 with a trade-off | 64.839 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| DeepSeek-V4.1-Flashlow · API + NVIDIA RTX PRO 6000 Blackwell · first releasechat model, answer-letter probabilities · API | 79.5292 with a trade-off | 65.91,344 with a trade-off | 47.573 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Grok 4.7low | 77.3295 with a trade-off | 64.11,212 with a trade-off | 66.3106 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Gemma 4 31Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 74.7295 with a trade-off | 60.51,249 with a trade-off | 59.660 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Sonnet 5.5lowchat model, one letter · subscription | 74.8312 with a trade-off | 59.41,221 with a trade-off | 62.246 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Gemma 4 31Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 69.7272 with a trade-off | 59.81,029 with a trade-off | 56.378 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GNUbg weakprogram · CPU | 53.5266 with a trade-off | 63.51,381 with a trade-off | 93.825 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Qwen3.8-27Blow · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 66.8285 with a trade-off | 60.31,170 with a trade-off | 57.775 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| d1-ultra | 70.1294 with a trade-off | 60.51,135 with a trade-off | 56.975 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GLM-5.3lowchat model, answer-letter probabilities · API | 71.2296 with a trade-off | 58.41,110 with a trade-off | 58.345 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Jev 1.14 | 68.2272 with a trade-off | 56.51,060 with a trade-off | 45.035 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GLiDEAPI | 70.2293 with a trade-off | 56.81,216 with a trade-off | 58.466 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Qwen3.8 Flashoffchat model, answer-letter probabilities · API | 65.2298 with a trade-off | 57.21,110 with a trade-off | 46.223 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| DeepSeek-V4.1-Flashoff · API · 1017chat model, answer-letter probabilities · API | 62.1304 with a trade-off | 57.21,129 with a trade-off | 47.625 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| ClefNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 72.0278 with a trade-off | 53.71,174 with a trade-off | 61.112 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
Hit risk only: being hit. Gammon risk and priming are not in it.
Game phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| Gemini 3.8 Flashhighchat model, one letter · subscription | 12.0308 | 20.21,363 | Too few decisions54 | 2.0244 | Too few decisions199 |
| Gemini 3.8 Flashlowchat model, one letter · subscription | 13.2302 | 20.41,279 | Too few decisions83 | 6.8218 | Too few decisions171 |
| Claude Sonnet 5.5highchat model, one letter · subscription | 13.7300 | 21.41,417 | Too few decisions56 | 3.9234 | Too few decisions157 |
| DeepSeek-V4.1-Flashlow · API · 1017chat model, answer-letter probabilities · API | 15.7318 | 21.61,439 | Too few decisions66 | 4.7238 | Too few decisions161 |
| Claude Fable 5.1low | 13.9290 | 22.91,285 | Too few decisions54 | 5.9216 | Too few decisions163 |
| DeepSeek-V4.1-Flashlow · API + NVIDIA RTX PRO 6000 Blackwell · first releasechat model, answer-letter probabilities · API | 16.9296 | 23.21,434 | Too few decisions86 | 2.3231 | Too few decisions141 |
| Grok 4.7low | 17.6297 | 25.41,320 | Too few decisions121 | 2.9217 | Too few decisions197 |
| Gemma 4 31Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 19.0298 | 24.31,367 | Too few decisions65 | 6.0228 | Too few decisions164 |
| Claude Sonnet 5.5lowchat model, one letter · subscription | 17.5313 | 26.21,340 | Too few decisions56 | 6.0251 | Too few decisions190 |
| Gemma 4 31Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 18.8273 | 27.31,121 | Too few decisions87 | 15.9224 | Too few decisions142 |
| GNUbg weakprogram · CPU | 36.3271 | 30.31,502 | Too few decisions25 | 5.0247 | Too few decisions91 |
| Qwen3.8-27Blow · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 32.9288 | 34.21,305 | Too few decisions82 | 15.5246 | Too few decisions187 |
| d1-ultra | 27.7294 | 36.01,263 | Too few decisions93 | 15.0263 | Too few decisions158 |
| GLM-5.3lowchat model, answer-letter probabilities · API | 29.0297 | 36.41,257 | Too few decisions50 | 21.3254 | Too few decisions131 |
| Jev 1.14 | 37.6272 | 35.11,237 | Too few decisions40 | 16.1220 | Too few decisions143 |
| GLiDEAPI | 25.0297 | 42.61,333 | Too few decisions75 | 14.1291 | Too few decisions163 |
| Qwen3.8 Flashoffchat model, answer-letter probabilities · API | 36.8298 | 37.11,337 | Too few decisions27 | 20.6249 | Too few decisions116 |
| DeepSeek-V4.1-Flashoff · API · 1017chat model, answer-letter probabilities · API | 39.6305 | 41.51,299 | Too few decisions28 | 18.7270 | Too few decisions132 |
| ClefNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 32.1280 | 41.81,361 | Too few decisions15 | 26.7206 | Too few decisions116 |
Strategy tag (contact and holding positions after the opening)
Swipe for more columns →
| Model and setting | Blitz | Back game | Holding game | Priming | Low-anchor | Other |
|---|---|---|---|---|---|---|
| Gemini 3.8 Flashhighchat model, one letter · subscription | Too few decisions195 | Too few decisions77 | Too few decisions54 | 17.1546 | 22.1423 | Too few decisions122 |
| Gemini 3.8 Flashlowchat model, one letter · subscription | 16.6268 | Too few decisions62 | Too few decisions83 | 18.4408 | 25.0338 | 22.7203 |
| Claude Sonnet 5.5highchat model, one letter · subscription | 21.1263 | Too few decisions51 | Too few decisions56 | 22.0578 | 20.6374 | Too few decisions151 |
| DeepSeek-V4.1-Flashlow · API · 1017chat model, answer-letter probabilities · API | 18.2309 | Too few decisions77 | Too few decisions66 | 20.7548 | 28.7337 | Too few decisions168 |
| Claude Fable 5.1low | 17.0261 | Too few decisions78 | Too few decisions54 | 23.3508 | 27.3325 | Too few decisions113 |
| DeepSeek-V4.1-Flashlow · API + NVIDIA RTX PRO 6000 Blackwell · first releasechat model, answer-letter probabilities · API | 19.1334 | Too few decisions108 | Too few decisions86 | 23.0504 | 27.7335 | Too few decisions153 |
| Grok 4.7low | 23.4359 | Too few decisions52 | Too few decisions121 | 27.8479 | 28.7281 | Too few decisions149 |
| Gemma 4 31Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 22.5296 | Too few decisions75 | Too few decisions65 | 19.9417 | 26.8432 | Too few decisions147 |
| Claude Sonnet 5.5lowchat model, one letter · subscription | 21.3297 | Too few decisions37 | Too few decisions56 | 25.8494 | 29.2392 | Too few decisions120 |
| Gemma 4 31Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 26.2203 | Too few decisions59 | Too few decisions87 | 28.4370 | 31.3343 | Too few decisions146 |
| GNUbg weakprogram · CPU | 21.6597 | Too few decisions85 | Too few decisions25 | 34.5354 | 35.3266 | 41.1200 |
| Qwen3.8-27Blow · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 34.1293 | Too few decisions48 | Too few decisions82 | 30.4405 | 35.5381 | Too few decisions178 |
| d1-ultra | 25.7266 | Too few decisions62 | Too few decisions93 | 38.3518 | 41.8305 | Too few decisions112 |
| GLM-5.3lowchat model, answer-letter probabilities · API | 27.5224 | Too few decisions31 | Too few decisions50 | 33.5565 | 46.2349 | Too few decisions88 |
| Jev 1.14 | 26.5210 | Too few decisions56 | Too few decisions40 | 33.3470 | 39.4371 | Too few decisions130 |
| GLiDEAPI | 40.8286 | Too few decisions55 | Too few decisions75 | 41.9441 | 48.4369 | Too few decisions182 |
| Qwen3.8 Flashoffchat model, answer-letter probabilities · API | 39.3209 | Too few decisions54 | Too few decisions27 | 34.3640 | 40.9362 | Too few decisions72 |
| DeepSeek-V4.1-Flashoff · API · 1017chat model, answer-letter probabilities · API | 34.1240 | Too few decisions23 | Too few decisions28 | 42.9506 | 47.0423 | Too few decisions107 |
| ClefNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 44.5296 | Too few decisions84 | Too few decisions15 | 40.2516 | 43.1341 | Too few decisions124 |
Number of legal plays
Swipe for more columns →
| Model and setting | 2–5 | 6–10 | 11–15 | 16–25 | 26+ |
|---|---|---|---|---|---|
| Gemini 3.8 Flashhighchat model, one letter · subscription | 7.0665 | 14.5483 | 18.6369 | 21.8385 | 20.6266 |
| Gemini 3.8 Flashlowchat model, one letter · subscription | 7.7641 | 18.3427 | 16.7345 | 20.9418 | 28.3222 |
| Claude Sonnet 5.5highchat model, one letter · subscription | 7.5654 | 18.5461 | 21.0373 | 21.4401 | 23.2275 |
| DeepSeek-V4.1-Flashlow · API · 1017chat model, answer-letter probabilities · API | 7.7679 | 18.3434 | 23.7380 | 20.3442 | 24.2287 |
| Claude Fable 5.1low | 11.1631 | 17.1444 | 22.2327 | 22.5362 | 24.5244 |
| DeepSeek-V4.1-Flashlow · API + NVIDIA RTX PRO 6000 Blackwell · first releasechat model, answer-letter probabilities · API | 9.0599 | 19.7452 | 21.6392 | 26.3440 | 23.5305 |
| Grok 4.7low | 6.8644 | 21.1442 | 24.0360 | 25.4436 | 28.5270 |
| Gemma 4 31Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 8.8659 | 22.2453 | 21.1331 | 26.9399 | 28.5280 |
| Claude Sonnet 5.5lowchat model, one letter · subscription | 9.8678 | 23.8524 | 24.4351 | 24.4363 | 29.0234 |
| Gemma 4 31Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 8.5593 | 21.6416 | 31.1324 | 30.6318 | Too few decisions196 |
| GNUbg weakprogram · CPU | 14.4462 | 23.4388 | 26.4298 | 34.0420 | 34.7568 |
| Qwen3.8-27Blow · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 17.4648 | 26.1469 | 35.6364 | 33.4399 | 50.0228 |
| d1-ultra | 10.5616 | 29.5419 | 38.8314 | 41.1404 | 47.9318 |
| GLM-5.3lowchat model, answer-letter probabilities · API | 14.4645 | 33.8469 | 34.5328 | 43.1335 | 49.3212 |
| Jev 1.14 | 14.7639 | 33.0397 | 44.8290 | 37.1335 | 50.9251 |
| GLiDEAPI | 17.4655 | 29.5486 | 40.9339 | 41.8406 | 55.0273 |
| Qwen3.8 Flashoffchat model, answer-letter probabilities · API | 15.8702 | 36.5442 | 45.5337 | 43.3358 | Too few decisions188 |
| DeepSeek-V4.1-Flashoff · API · 1017chat model, answer-letter probabilities · API | 15.7692 | 40.8456 | 47.8373 | 45.4325 | Too few decisions188 |
| ClefNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 22.0670 | 41.2430 | 37.5319 | 42.5346 | 61.8213 |
Equity gap between the two best plays
Swipe for more columns →
| Model and setting | Under 0.02 | 0.02 to 0.08 | Over 0.08 |
|---|---|---|---|
| Gemini 3.8 Flashhighchat model, one letter · subscription | 8.7904 | 17.1677 | 22.1587 |
| Gemini 3.8 Flashlowchat model, one letter · subscription | 10.5784 | 18.5663 | 21.5606 |
| Claude Sonnet 5.5highchat model, one letter · subscription | 11.0821 | 17.8661 | 22.5682 |
| DeepSeek-V4.1-Flashlow · API · 1017chat model, answer-letter probabilities · API | 10.1867 | 20.5723 | 22.9632 |
| Claude Fable 5.1low | 12.9791 | 20.8642 | 21.5575 |
| DeepSeek-V4.1-Flashlow · API + NVIDIA RTX PRO 6000 Blackwell · first releasechat model, answer-letter probabilities · API | 12.8863 | 21.0678 | 25.2647 |
| Grok 4.7low | 11.4902 | 22.5666 | 27.2584 |
| Gemma 4 31Bon · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 15.2807 | 22.0698 | 22.6617 |
| Claude Sonnet 5.5lowchat model, one letter · subscription | 13.5826 | 20.6697 | 28.5627 |
| Gemma 4 31Boff · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 17.5756 | 22.5583 | 29.9508 |
| GNUbg weakprogram · CPU | 17.2959 | 31.6625 | 38.8552 |
| Qwen3.8-27Blow · NVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Sparkchat model, answer-letter probabilities · our GPUs | 17.9842 | 30.4651 | 42.9615 |
| d1-ultra | 20.5842 | 33.1664 | 41.8565 |
| GLM-5.3lowchat model, answer-letter probabilities · API | 19.1790 | 31.2592 | 45.9607 |
| Jev 1.14 | 19.6780 | 33.0620 | 48.6512 |
| GLiDEAPI | 21.0893 | 35.4635 | 48.1631 |
| Qwen3.8 Flashoffchat model, answer-letter probabilities · API | 18.2854 | 30.8658 | 62.6515 |
| DeepSeek-V4.1-Flashoff · API · 1017chat model, answer-letter probabilities · API | 20.9795 | 32.1608 | 56.3631 |
| ClefNVIDIA RTX PRO 6000 Blackwell + NVIDIA DGX Spark | 24.2792 | 37.5617 | 52.7569 |
League 3
FinishedPublishedRisk judgement per phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| GPT-6.1 Solhigh | 82.4183 with a trade-off | 66.6765 with a trade-off | 72.377 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GPT-6 Astramediumchat model, one letter · subscription | 83.6183 with a trade-off | 71.1785 with a trade-off | 50.052 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GPT-6 Astralowchat model, one letter · subscription | 87.6177 with a trade-off | 71.9693 with a trade-off | 63.640 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GPT-6.1 Sollow | 80.1194 with a trade-off | 69.1767 with a trade-off | 65.464 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Gemini 4 Argonhighchat model, one letter · subscription | 82.1188 with a trade-off | 70.4708 with a trade-off | 48.642 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Fable 5.1highchat model, one letter · subscription | 90.1174 with a trade-off | 66.1752 with a trade-off | 58.661 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Opus 5.5highchat model, one letter · subscription | 80.4204 with a trade-off | 66.0813 with a trade-off | 55.653 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Claude Opus 5.5lowchat model, one letter · subscription | 76.6199 with a trade-off | 63.4781 with a trade-off | 56.263 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Gemini 4 Argonlowchat model, one letter · subscription | 79.1205 with a trade-off | 64.8762 with a trade-off | 61.869 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Grok 4.7highchat model, one letter · subscription | 80.2201 with a trade-off | 64.3635 with a trade-off | 52.484 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| Kimi K3.1 Prooffchat model, one letter · API | 76.6166 with a trade-off | 61.5615 with a trade-off | 54.545 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
| GNUbg weakprogram · CPU | 52.5178 with a trade-off | 64.2915 with a trade-off | 47.031 with a trade-off | N/A0 with a trade-off | N/A0 with a trade-off |
Hit risk only: being hit. Gammon risk and priming are not in it.
Game phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| GPT-6.1 Solhigh | Too few decisions183 | 13.6824 | Too few decisions85 | Too few decisions150 | Too few decisions147 |
| GPT-6 Astramediumchat model, one letter · subscription | Too few decisions184 | 14.1887 | Too few decisions62 | Too few decisions137 | Too few decisions92 |
| GPT-6 Astralowchat model, one letter · subscription | Too few decisions179 | 15.6799 | Too few decisions49 | Too few decisions136 | Too few decisions88 |
| GPT-6.1 Sollow | Too few decisions196 | 16.2826 | Too few decisions71 | Too few decisions128 | Too few decisions123 |
| Gemini 4 Argonhighchat model, one letter · subscription | Too few decisions191 | 17.2814 | Too few decisions54 | Too few decisions153 | Too few decisions120 |
| Claude Fable 5.1highchat model, one letter · subscription | Too few decisions176 | 18.7840 | Too few decisions74 | Too few decisions116 | Too few decisions80 |
| Claude Opus 5.5highchat model, one letter · subscription | 13.5204 | 18.6925 | Too few decisions70 | Too few decisions137 | Too few decisions141 |
| Claude Opus 5.5lowchat model, one letter · subscription | Too few decisions199 | 20.6856 | Too few decisions73 | Too few decisions161 | Too few decisions122 |
| Gemini 4 Argonlowchat model, one letter · subscription | 10.4208 | 23.4856 | Too few decisions80 | Too few decisions184 | Too few decisions156 |
| Grok 4.7highchat model, one letter · subscription | 17.6201 | 27.5724 | Too few decisions101 | Too few decisions161 | Too few decisions150 |
| Kimi K3.1 Prooffchat model, one letter · API | Too few decisions168 | 36.6717 | Too few decisions53 | Too few decisions158 | Too few decisions71 |
| GNUbg weakprogram · CPU | Too few decisions180 | 31.61,026 | Too few decisions37 | Too few decisions160 | Too few decisions76 |
Strategy tag (contact and holding positions after the opening)
Swipe for more columns →
| Model and setting | Blitz | Back game | Holding game | Priming | Low-anchor | Other |
|---|---|---|---|---|---|---|
| GPT-6.1 Solhigh | 11.0223 | Too few decisions49 | Too few decisions85 | 13.6300 | Too few decisions148 | Too few decisions104 |
| GPT-6 Astramediumchat model, one letter · subscription | 12.7239 | Too few decisions86 | Too few decisions62 | 13.8311 | Too few decisions186 | Too few decisions65 |
| GPT-6 Astralowchat model, one letter · subscription | Too few decisions192 | Too few decisions57 | Too few decisions49 | 15.9366 | Too few decisions136 | Too few decisions48 |
| GPT-6.1 Sollow | Too few decisions190 | Too few decisions60 | Too few decisions71 | 17.7326 | Too few decisions152 | Too few decisions98 |
| Gemini 4 Argonhighchat model, one letter · subscription | Too few decisions163 | Too few decisions58 | Too few decisions54 | 17.5342 | Too few decisions145 | Too few decisions106 |
| Claude Fable 5.1highchat model, one letter · subscription | 20.9208 | Too few decisions154 | Too few decisions74 | 15.9286 | Too few decisions110 | Too few decisions82 |
| Claude Opus 5.5highchat model, one letter · subscription | 15.3201 | Too few decisions90 | Too few decisions70 | 14.9341 | Too few decisions159 | Too few decisions134 |
| Claude Opus 5.5lowchat model, one letter · subscription | Too few decisions170 | Too few decisions81 | Too few decisions73 | 18.5315 | Too few decisions181 | Too few decisions109 |
| Gemini 4 Argonlowchat model, one letter · subscription | Too few decisions173 | Too few decisions62 | Too few decisions80 | 25.6377 | Too few decisions122 | Too few decisions122 |
| Grok 4.7highchat model, one letter · subscription | Too few decisions144 | Too few decisions14 | Too few decisions101 | 26.0341 | Too few decisions148 | Too few decisions77 |
| Kimi K3.1 Prooffchat model, one letter · API | Too few decisions177 | Too few decisions36 | Too few decisions53 | 28.4245 | Too few decisions167 | Too few decisions92 |
| GNUbg weakprogram · CPU | 20.6291 | Too few decisions142 | Too few decisions37 | 33.5250 | Too few decisions171 | Too few decisions172 |
Number of legal plays
Swipe for more columns →
| Model and setting | 2–5 | 6–10 | 11–15 | 16–25 | 26+ |
|---|---|---|---|---|---|
| GPT-6.1 Solhigh | 5.6342 | 9.0256 | 10.2215 | 12.0311 | 13.6265 |
| GPT-6 Astramediumchat model, one letter · subscription | 5.8381 | 8.7271 | 13.8230 | 12.3289 | Too few decisions191 |
| GPT-6 Astralowchat model, one letter · subscription | 5.0333 | 9.5271 | 12.5210 | 16.3255 | Too few decisions182 |
| GPT-6.1 Sollow | 6.9365 | 11.0274 | 13.8223 | 13.4257 | 18.9225 |
| Gemini 4 Argonhighchat model, one letter · subscription | 4.0395 | 11.9257 | 17.1206 | 17.2273 | 19.3201 |
| Claude Fable 5.1highchat model, one letter · subscription | 7.8383 | 15.5234 | Too few decisions199 | 18.0246 | 16.9224 |
| Claude Opus 5.5highchat model, one letter · subscription | 6.8444 | 15.5327 | 12.3259 | 24.8260 | Too few decisions187 |
| Claude Opus 5.5lowchat model, one letter · subscription | 7.7409 | 18.1297 | 18.1235 | 17.7277 | Too few decisions193 |
| Gemini 4 Argonlowchat model, one letter · subscription | 6.1406 | 16.5317 | 16.8238 | 25.1308 | 23.2215 |
| Grok 4.7highchat model, one letter · subscription | 4.3351 | 18.8283 | 26.4247 | 27.1248 | 24.2208 |
| Kimi K3.1 Prooffchat model, one letter · API | 15.9346 | 27.9246 | Too few decisions193 | 37.1237 | Too few decisions145 |
| GNUbg weakprogram · CPU | 10.0362 | 25.6285 | 32.8225 | 33.6310 | 43.1297 |
Equity gap between the two best plays
Swipe for more columns →
| Model and setting | Under 0.02 | 0.02 to 0.08 | Over 0.08 |
|---|---|---|---|
| GPT-6.1 Solhigh | 6.4624 | 14.2406 | 11.1359 |
| GPT-6 Astramediumchat model, one letter · subscription | 7.9569 | 11.8427 | 15.3366 |
| GPT-6 Astralowchat model, one letter · subscription | 7.6526 | 15.3388 | 14.4337 |
| GPT-6.1 Sollow | 8.2571 | 13.1409 | 17.1364 |
| Gemini 4 Argonhighchat model, one letter · subscription | 8.3594 | 15.4394 | 16.8344 |
| Claude Fable 5.1highchat model, one letter · subscription | 8.8519 | 19.5415 | 15.0352 |
| Claude Opus 5.5highchat model, one letter · subscription | 11.6561 | 15.6464 | 16.7452 |
| Claude Opus 5.5lowchat model, one letter · subscription | 10.7616 | 18.9403 | 19.3392 |
| Gemini 4 Argonlowchat model, one letter · subscription | 8.8671 | 19.6455 | 26.8358 |
| Grok 4.7highchat model, one letter · subscription | 8.8588 | 17.8423 | 38.1326 |
| Kimi K3.1 Prooffchat model, one letter · API | 19.1515 | 33.0327 | 37.2325 |
| GNUbg weakprogram · CPU | 18.4642 | 34.5447 | 36.8390 |
Earlier version: the v1 set
Earlier versionGame phase
Swipe for more columns →
| Model and setting | Opening | Contact | Holding game | Race | Bear-off |
|---|---|---|---|---|---|
| GPT-6 Astrachat model, one letter · subscription | Too few decisions143 | 15.1641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Gemini 4 Argonchat model, one letter · API | Too few decisions143 | 22.4641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Claude Opus 5.5chat model, one letter · subscription | Too few decisions143 | 23.0641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| DeepSeek-V4.1-Flashthinking · first releasechat model, one letter · our GPUs | Too few decisions143 | 23.4641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Gemini 3.8 Flashchat model, one letter · API | Too few decisions143 | 23.6641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Gemini 4 Argonshuffledchat model, one letter · API · shuffled play order | Too few decisions143 | 25.7641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Gemma 4 31Bchat model, answer-letter probabilities · our GPUs | Too few decisions143 | 29.0641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| DeepSeek-V4.1-Flashfirst releasechat model, answer-letter probabilities · our GPUs | Too few decisions143 | 33.7641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Qwen3.8 Flash Nextchat model, answer-letter probabilities · our GPUs | Too few decisions143 | 37.9641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Perplexity Decider 27B v1.1decision model · our GPUs | Too few decisions143 | 41.2641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Jev 1.13decision model · API | Too few decisions143 | 39.2641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Clefdecision model · our GPUs | Too few decisions143 | 42.8641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| GPT-6 LunaDecisions APIdecision model · API | Too few decisions143 | 40.5641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Cygnetdecision model · our GPUs | Too few decisions143 | 45.5641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| GLM-4.7-Flashchat model, answer-letter probabilities · our GPUs | Too few decisions143 | 61.3641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| Open-Jev 27Bdecision model · our GPUs | Too few decisions143 | 82.0641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
| GLM-5.3-Flash NVFP4chat model, answer-letter probabilities | Too few decisions143 | 106.4641 | Too few decisions20 | Too few decisions136 | Too few decisions60 |
Strategy tag (contact and holding positions after the opening)
Swipe for more columns →
| Model and setting | Blitz | Back game | Holding game | Priming | Low-anchor | Other |
|---|---|---|---|---|---|---|
| GPT-6 Astrachat model, one letter · subscription | Too few decisions143 | Too few decisions30 | Too few decisions20 | 14.7235 | Too few decisions168 | Too few decisions65 |
| Gemini 4 Argonchat model, one letter · API | Too few decisions143 | Too few decisions30 | Too few decisions20 | 20.1235 | Too few decisions168 | Too few decisions65 |
| Claude Opus 5.5chat model, one letter · subscription | Too few decisions143 | Too few decisions30 | Too few decisions20 | 19.6235 | Too few decisions168 | Too few decisions65 |
| DeepSeek-V4.1-Flashthinking · first releasechat model, one letter · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 21.8235 | Too few decisions168 | Too few decisions65 |
| Gemini 3.8 Flashchat model, one letter · API | Too few decisions143 | Too few decisions30 | Too few decisions20 | 18.6235 | Too few decisions168 | Too few decisions65 |
| Gemini 4 Argonshuffledchat model, one letter · API · shuffled play order | Too few decisions143 | Too few decisions30 | Too few decisions20 | 23.6235 | Too few decisions168 | Too few decisions65 |
| Gemma 4 31Bchat model, answer-letter probabilities · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 28.1235 | Too few decisions168 | Too few decisions65 |
| DeepSeek-V4.1-Flashfirst releasechat model, answer-letter probabilities · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 33.6235 | Too few decisions168 | Too few decisions65 |
| Qwen3.8 Flash Nextchat model, answer-letter probabilities · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 35.0235 | Too few decisions168 | Too few decisions65 |
| Perplexity Decider 27B v1.1decision model · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 41.0235 | Too few decisions168 | Too few decisions65 |
| Jev 1.13decision model · API | Too few decisions143 | Too few decisions30 | Too few decisions20 | 40.6235 | Too few decisions168 | Too few decisions65 |
| Clefdecision model · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 43.3235 | Too few decisions168 | Too few decisions65 |
| GPT-6 LunaDecisions APIdecision model · API | Too few decisions143 | Too few decisions30 | Too few decisions20 | 37.6235 | Too few decisions168 | Too few decisions65 |
| Cygnetdecision model · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 45.7235 | Too few decisions168 | Too few decisions65 |
| GLM-4.7-Flashchat model, answer-letter probabilities · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 62.4235 | Too few decisions168 | Too few decisions65 |
| Open-Jev 27Bdecision model · our GPUs | Too few decisions143 | Too few decisions30 | Too few decisions20 | 80.1235 | Too few decisions168 | Too few decisions65 |
| GLM-5.3-Flash NVFP4chat model, answer-letter probabilities | Too few decisions143 | Too few decisions30 | Too few decisions20 | 106.5235 | Too few decisions168 | Too few decisions65 |
Number of legal plays
Swipe for more columns →
| Model and setting | 2–5 | 6–10 | 11–15 | 16–25 | 26+ |
|---|---|---|---|---|---|
| GPT-6 Astrachat model, one letter · subscription | 8.0385 | 10.8234 | Too few decisions168 | 12.9213 | Too few decisions0 |
| Gemini 4 Argonchat model, one letter · API | 7.8385 | 17.9234 | Too few decisions168 | 24.1213 | Too few decisions0 |
| Claude Opus 5.5chat model, one letter · subscription | 10.5385 | 18.0234 | Too few decisions168 | 20.3213 | Too few decisions0 |
| DeepSeek-V4.1-Flashthinking · first releasechat model, one letter · our GPUs | 10.8385 | 18.5234 | Too few decisions168 | 24.3213 | Too few decisions0 |
| Gemini 3.8 Flashchat model, one letter · API | 11.5385 | 18.5234 | Too few decisions168 | 21.8213 | Too few decisions0 |
| Gemini 4 Argonshuffledchat model, one letter · API · shuffled play order | 8.6385 | 20.4234 | Too few decisions168 | 26.5213 | Too few decisions0 |
| Gemma 4 31Bchat model, answer-letter probabilities · our GPUs | 16.4385 | 23.7234 | Too few decisions168 | 32.4213 | Too few decisions0 |
| DeepSeek-V4.1-Flashfirst releasechat model, answer-letter probabilities · our GPUs | 14.5385 | 31.5234 | Too few decisions168 | 37.0213 | Too few decisions0 |
| Qwen3.8 Flash Nextchat model, answer-letter probabilities · our GPUs | 17.4385 | 36.7234 | Too few decisions168 | 41.8213 | Too few decisions0 |
| Perplexity Decider 27B v1.1decision model · our GPUs | 19.0385 | 35.5234 | Too few decisions168 | 44.5213 | Too few decisions0 |
| Jev 1.13decision model · API | 20.7385 | 35.6234 | Too few decisions168 | 41.4213 | Too few decisions0 |
| Clefdecision model · our GPUs | 21.0385 | 36.8234 | Too few decisions168 | 43.8213 | Too few decisions0 |
| GPT-6 LunaDecisions APIdecision model · API | 18.1385 | 41.9234 | Too few decisions168 | 48.5213 | Too few decisions0 |
| Cygnetdecision model · our GPUs | 25.9385 | 41.5234 | Too few decisions168 | 47.6213 | Too few decisions0 |
| GLM-4.7-Flashchat model, answer-letter probabilities · our GPUs | 41.8385 | 49.6234 | Too few decisions168 | 65.6213 | Too few decisions0 |
| Open-Jev 27Bdecision model · our GPUs | 35.1385 | 67.0234 | Too few decisions168 | 85.5213 | Too few decisions0 |
| GLM-5.3-Flash NVFP4chat model, answer-letter probabilities | 28.5385 | 88.4234 | Too few decisions168 | 139.3213 | Too few decisions0 |
Equity gap between the two best plays
Swipe for more columns →
| Model and setting | Under 0.02 | 0.02 to 0.08 | Over 0.08 |
|---|---|---|---|
| GPT-6 Astrachat model, one letter · subscription | 6.5409 | 13.6291 | 15.3300 |
| Gemini 4 Argonchat model, one letter · API | 9.7409 | 17.7291 | 26.0300 |
| Claude Opus 5.5chat model, one letter · subscription | 10.8409 | 18.9291 | 24.4300 |
| DeepSeek-V4.1-Flashthinking · first releasechat model, one letter · our GPUs | 11.2409 | 21.3291 | 24.5300 |
| Gemini 3.8 Flashchat model, one letter · API | 11.0409 | 22.4291 | 24.1300 |
| Gemini 4 Argonshuffledchat model, one letter · API · shuffled play order | 12.4409 | 21.1291 | 25.6300 |
| Gemma 4 31Bchat model, answer-letter probabilities · our GPUs | 14.1409 | 24.5291 | 35.5300 |
| DeepSeek-V4.1-Flashfirst releasechat model, answer-letter probabilities · our GPUs | 17.5409 | 28.4291 | 40.1300 |
| Qwen3.8 Flash Nextchat model, answer-letter probabilities · our GPUs | 20.8409 | 29.0291 | 47.2300 |
| Perplexity Decider 27B v1.1decision model · our GPUs | 20.4409 | 31.2291 | 47.9300 |
| Jev 1.13decision model · API | 22.9409 | 35.0291 | 46.9300 |
| Clefdecision model · our GPUs | 23.5409 | 34.8291 | 47.7300 |
| GPT-6 LunaDecisions APIdecision model · API | 23.4409 | 33.4291 | 52.3300 |
| Cygnetdecision model · our GPUs | 24.6409 | 39.5291 | 57.8300 |
| GLM-4.7-Flashchat model, answer-letter probabilities · our GPUs | 27.9409 | 49.8291 | 82.2300 |
| Open-Jev 27Bdecision model · our GPUs | 37.7409 | 66.6291 | 83.5300 |
| GLM-5.3-Flash NVFP4chat model, answer-letter probabilities | 55.1409 | 95.4291 | 117.1300 |
Earlier version: plays were listed in the runner's order, which tends to put the best play early. When Gemini 4 Argon answered the same 1,000 positions with the plays shuffled, its error rate changed by +1.9 (95% interval −0.2 to +4.2), so the effect is not proven.
About these tables
Error rate by game phase, strategy tag, number of legal plays and the equity gap between the two best plays. Each league on its own; the shared-position version waits for the answers. A cell with fewer decisions than the minimum shows the status instead of a value.