Where models disagree

Where do models disagree?

Results f24d1f41, updated 16 November 2026, 22:20 UTC; scored by GNU Backgammon 1.08, 2-ply.

Earlier version: the v1 set

Earlier version

Swipe for more columns →

The 150 positions with the most different plays (then the fewest engine-best choices)
PositionPhaseLegal playsDifferent plays chosenSetups choosing the engine's bestMost common playEngine's best play
v1-0292Opening19106%13/9 9/835% of setups, loses 0.0128/4* 24/23
v1-0370Contact2380%6/3 6/535% of setups, loses 0.0486/3 3/2
v1-0436Race1386%11/9 9/829% of setups, loses 0.0288/6 13/12
v1-0796Contact18812%6/1 6/418% of setups, loses 0.0516/1 19/17
v1-0708Contact22824%6/5 5/141% of setups, loses 0.0654/3 6/2
v1-0801Contact17824%24/18* 18/1629% of setups, loses 0.01913/11 24/18*
v1-0079Contact1370%6/1 5/329% of setups, loses 0.95221/16* 11/9
v1-0735Contact1470%7/3 15/1335% of setups, loses 0.05015/11 11/9
v1-0210Contact1176%3/1 1/off53% of setups, loses 0.0256/4 1/off
v1-0602Contact1776%8/6 24/2041% of setups, loses 0.0063/1 24/20
v1-0791Race1676%8/7 7/453% of setups, loses 0.00514/13 8/5
v1-0671Contact19712%bar/24 6/5 6/5 2/147% of setups, loses 0.016bar/24 6/5 3/2 2/1
v1-0260Opening18718%13/11 11/529% of setups, loses 0.28213/11 24/18*
v1-0281Race21718%8/5 5/329% of setups, loses 0.13919/16 19/17
v1-0014Contact12729%24/22 24/18*29% of setups, loses 0.00024/22 24/18*
v1-0854Contact20735%24/22* 24/2135% of setups, loses 0.00024/22* 24/21
v1-0489Opening16747%24/20 20/15*47% of setups, loses 0.00024/20 20/15*
v1-0667Contact12747%13/10 10/4*47% of setups, loses 0.00013/10 10/4*
v1-0495Opening17759%24/21 13/1159% of setups, loses 0.00024/21 13/11
v1-0287Contact10765%16/11 4/365% of setups, loses 0.00016/11 4/3
v1-0041Opening1160%13/11 6/541% of setups, loses 0.03424/22 6/5
v1-0261Contact1360%13/9 13/753% of setups, loses 0.15224/18 18/14
v1-0304Opening1060%13/7 7/547% of setups, loses 0.01724/22 22/16
v1-0309Opening1260%13/11 11/629% of setups, loses 0.07524/22 6/1*
v1-0557Opening1860%13/9 13/1047% of setups, loses 0.00724/20 13/10
v1-0624Contact2160%7/2 6/529% of setups, loses 0.34513/8 24/23
v1-0742Race1460%8/3 3/147% of setups, loses 0.33013/8 8/6
v1-0785Contact2160%6/3 8/365% of setups, loses 0.17324/21 21/16
v1-0805Contact1960%2/1* 4/153% of setups, loses 0.4146/5 24/21
v1-0827Contact1360%24/18 24/18 14/8 8/241% of setups, loses 0.20124/18 20/14 18/12 14/8
v1-0829Contact1260%6/3 6/447% of setups, loses 0.31410/7 10/8
v1-0031Holding game1866%18/15 18/15 15/12 15/1265% of setups, loses 0.03618/15 15/12 12/9 9/6
v1-0074Contact2566%6/1* 6/4*35% of setups, loses 0.12321/16 16/14*
v1-0101Race866%19/13 14/1235% of setups, loses 0.00119/13 13/11
v1-0131Contact1866%6/5 7/559% of setups, loses 0.03013/12 24/22
v1-0146Opening1566%13/11 6/565% of setups, loses 0.01113/11 24/23
v1-0214Race2366%20/16 3/153% of setups, loses 0.03816/12 20/18
v1-0283Contact966%12/7 3/253% of setups, loses 0.09922/17 12/11
v1-0313Contact1066%13/11 5/271% of setups, loses 0.02113/11 11/8
v1-0460Contact1366%7/2 7/535% of setups, loses 0.45816/11 11/9
v1-0530Race1466%12/7 13/741% of setups, loses 0.01713/8 12/6
v1-0572Contact966%bar/19 19/13 13/7 7/147% of setups, loses 0.125bar/19 19/13 15/9 13/7
v1-0699Contact1366%13/9 9/629% of setups, loses 0.1008/4 8/5
v1-0746Contact1866%7/2 3/247% of setups, loses 0.14514/9 7/6
v1-0909Opening1666%13/7 8/447% of setups, loses 0.04813/7 24/20
v1-0957Race1466%19/14 19/14 19/14 13/853% of setups, loses 0.02419/14 19/14 19/14 14/9
v1-0993Opening1866%13/9 13/1041% of setups, loses 0.06313/9 24/21
v1-0005Contact13612%9/6 6/453% of setups, loses 0.0839/6 13/11
v1-0377Race6612%10/8 8/241% of setups, loses 0.04610/8 17/11
v1-0428Contact15612%6/5 18/1359% of setups, loses 0.01818/17 17/12
v1-0482Contact25612%13/9 9/847% of setups, loses 0.09613/9 6/5
v1-0511Contact14612%6/2 7/1*35% of setups, loses 0.30524/20 20/14
v1-0629Contact14612%17/14 18/1453% of setups, loses 0.01417/14 14/10
v1-0700Race19612%13/10 5/447% of setups, loses 0.01810/7 7/6
v1-0826Contact14612%3/2 6/247% of setups, loses 0.06918/14 14/13
v1-0956Contact16612%11/5 6/259% of setups, loses 0.02111/5 8/4
v1-0118Contact16618%13/11 8/347% of setups, loses 0.03213/11 11/6
v1-0282Race21618%9/8 8/553% of setups, loses 0.00013/12 12/9
v1-0293Contact15618%24/19* 19/1329% of setups, loses 0.07920/14 24/19*
v1-0533Contact12618%10/7 11/559% of setups, loses 0.04211/8 10/4
v1-0639Race19624%13/9 13/1129% of setups, loses 0.0028/4 7/5
v1-0645Contact17624%13/9 16/1024% of setups, loses 0.00013/9 16/10
v1-0806Bear-off15624%4/3 1/off 1/off 1/off29% of setups, loses 0.0002/1 1/off 1/off 1/off
v1-0906Contact22624%13/10 7/129% of setups, loses 0.23724/21 24/18*
v1-0053Race18629%12/10 12/10 10/8 10/847% of setups, loses 0.07012/10 12/10 10/8 8/6
v1-0470Opening14629%13/7 8/5*29% of setups, loses 0.00013/7 8/5*
v1-0536Race6629%20/19 20/1429% of setups, loses 0.00020/19 20/14
v1-0824Contact24629%13/12* 5/247% of setups, loses 0.05813/12* 12/9
v1-0619Opening17635%13/11 13/1035% of setups, loses 0.00013/11 13/10
v1-0535Contact13641%7/4 13/1141% of setups, loses 0.0007/4 13/11
v1-0666Race11641%14/11 11/941% of setups, loses 0.00014/11 11/9
v1-0714Opening16641%6/2* 2/1*41% of setups, loses 0.0006/2* 2/1*
v1-0011Opening17647%13/9 13/1047% of setups, loses 0.00013/9 13/10
v1-0515Contact22647%13/10 10/647% of setups, loses 0.00013/10 10/6
v1-0622Opening11647%24/18 13/1147% of setups, loses 0.00024/18 13/11
v1-0637Contact23647%17/16 16/1247% of setups, loses 0.00017/16 16/12
v1-0774Contact19647%4/2 5/247% of setups, loses 0.0004/2 5/2
v1-0771Race24653%18/16 16/14 14/12 12/1053% of setups, loses 0.00018/16 16/14 14/12 12/10
v1-0553Race8659%17/15 18/1259% of setups, loses 0.00017/15 18/12
v1-0396Contact20665%20/18 8/265% of setups, loses 0.00020/18 8/2
v1-0718Contact11665%10/7 7/4 7/4 4/165% of setups, loses 0.00010/7 7/4 7/4 4/1
v1-0734Contact23665%8/5 7/4 7/4 7/465% of setups, loses 0.0008/5 7/4 7/4 7/4
v1-0818Contact14665%24/23 24/19*65% of setups, loses 0.00024/23 24/19*
v1-0934Contact6665%18/17 17/1365% of setups, loses 0.00018/17 17/13
v1-0984Contact14671%18/16* 18/1371% of setups, loses 0.00018/16* 18/13
v1-0018Contact1350%3/2* 2/off53% of setups, loses 0.0445/3 1/off
v1-0035Opening1050%13/8 13/965% of setups, loses 0.09824/20 20/15
v1-0061Contact2250%13/9 6/541% of setups, loses 0.13524/20 6/5
v1-0168Opening2350%6/5 13/1176% of setups, loses 0.0076/5 24/22
v1-0183Opening1850%22/16 16/1376% of setups, loses 0.02122/16 24/21
v1-0366Contact1950%10/5 3/241% of setups, loses 0.19621/16 16/15
v1-0376Contact950%13/9 9/641% of setups, loses 0.13613/9 24/21
v1-0434Contact1450%7/1 8/747% of setups, loses 0.39624/23 23/17
v1-0450Contact1650%6/4 6/276% of setups, loses 0.1296/4 24/20
v1-0503Contact2550%8/5 6/535% of setups, loses 0.15224/21 6/5
v1-0559Contact850%8/2 6/341% of setups, loses 0.04614/8 8/5
v1-0751Contact1550%3/2 6/241% of setups, loses 0.1092/1 24/20
v1-0769Contact1550%24/18 24/2147% of setups, loses 0.34124/18 8/5*
v1-0807Contact1450%13/9 9/353% of setups, loses 0.19124/20 22/16*
v1-0845Holding game1650%20/19* 19/1476% of setups, loses 0.13120/19* 20/15
v1-0870Contact1250%13/12 6/341% of setups, loses 0.10213/12 24/21
v1-0879Contact1350%8/2 6/365% of setups, loses 0.0208/2 8/5
v1-0889Contact2150%20/17 17/14 14/11 11/871% of setups, loses 0.04020/17 17/14 14/11 8/5
v1-0890Opening1550%13/7* 8/647% of setups, loses 0.12213/7* 24/22
v1-0901Contact2050%5/3 7/353% of setups, loses 0.10211/9 5/1*
v1-0925Contact2050%6/3 6/553% of setups, loses 0.4048/5 24/23
v1-0948Contact2450%13/11 13/1035% of setups, loses 0.03524/22 13/10
v1-0994Contact2550%6/5 8/559% of setups, loses 0.4376/5 24/21*
v1-0154Contact856%20/18* 18/1371% of setups, loses 0.03224/19 20/18*
v1-0180Contact1756%11/10 10/571% of setups, loses 0.02522/17 17/16
v1-0226Contact556%10/4 10/571% of setups, loses 0.00910/4 13/8
v1-0244Opening1656%6/2 8/247% of setups, loses 0.11124/20 20/14
v1-0325Contact1356%5/4 5/4 3/2 3/247% of setups, loses 0.0575/4 5/4 4/3 4/3
v1-0744Contact1956%5/4 4/253% of setups, loses 0.0213/2 15/13
v1-0834Contact1256%10/6 10/447% of setups, loses 0.12420/16 20/14
v1-0875Contact1356%8/3 6/371% of setups, loses 0.21924/19* 19/16
v1-0878Contact1456%7/1 6/176% of setups, loses 0.14921/15* 21/16
v1-0990Contact2056%21/18 18/1771% of setups, loses 0.00714/13 21/18
v1-0992Contact1556%6/4 9/471% of setups, loses 0.00524/22* 8/3
v1-0258Contact12512%8/2 8/547% of setups, loses 0.30524/21 21/15
v1-0300Holding game17512%9/8 13/953% of setups, loses 0.0062/1 13/9
v1-0512Contact20512%13/11 6/553% of setups, loses 0.0136/4* 4/3
v1-0569Contact14512%9/3 22/18*59% of setups, loses 0.06724/18* 22/18
v1-0621Contact7512%13/11 6/365% of setups, loses 0.01513/11 11/8
v1-0652Opening10512%24/22 13/859% of setups, loses 0.01313/11 13/8
v1-0966Contact13512%11/8 8/465% of setups, loses 0.03411/8 17/13
v1-0999Contact11512%5/2 5/365% of setups, loses 0.07912/9 12/10
v1-0025Opening10518%13/7 7/2*41% of setups, loses 0.07024/18 18/13
v1-0098Contact18518%3/1 3/235% of setups, loses 0.17124/22 22/21
v1-0412Contact15518%16/11 13/8 11/6 8/335% of setups, loses 0.13613/8 13/8 13/8 8/3
v1-0664Race15518%6/2 3/259% of setups, loses 0.0558/4 3/2
v1-0747Contact9518%8/6 8/559% of setups, loses 0.2345/3 5/2
v1-0773Contact8518%20/17 24/1965% of setups, loses 0.19320/17 17/12
v1-0298Opening15524%6/5 13/1159% of setups, loses 0.00324/23 13/11
v1-0371Contact21524%13/11 10/941% of setups, loses 0.1176/4 10/9
v1-0641Bear-off22524%6/5 5/4 4/3 2/141% of setups, loses 0.0102/1 2/1 1/off 1/off
v1-0686Contact9524%21/16 5/353% of setups, loses 0.05710/5 6/4
v1-0814Contact20524%7/6 7/559% of setups, loses 0.0385/4 3/1
v1-0872Contact24524%6/2 3/235% of setups, loses 0.72522/18* 13/12
v1-0082Contact20529%6/2* 7/247% of setups, loses 0.05813/9 13/8
v1-0097Contact15529%8/5 8/653% of setups, loses 0.1666/3 3/1
v1-0321Race10529%11/9 4/2 3/1 3/153% of setups, loses 0.12211/9 9/7 7/5 2/off
v1-0390Contact6529%24/18* 18/1647% of setups, loses 0.07724/22 24/18*
v1-0454Opening16529%11/10 13/829% of setups, loses 0.32224/23 23/18*
v1-0518Contact17529%18/13 13/9*29% of setups, loses 0.00018/13 13/9*
v1-0655Contact18529%4/3 4/3 3/2* 3/235% of setups, loses 0.1741/off 1/off 1/off 1/off
v1-0704Contact17529%10/8 8/553% of setups, loses 0.35421/18 18/16*
v1-0707Contact5529%bar/20 6/535% of setups, loses 0.029bar/20 7/6
v1-0736Contact12529%6/2 6/453% of setups, loses 0.16810/6 10/8
v1-0896Contact24529%8/6 8/747% of setups, loses 0.0066/4 5/4

1,000 positions, 17 setups. All setups chose the same play in 76 positions. Earlier version: plays were listed in the runner's order, which tends to put the best play early. When Gemini 4 Argon answered the same 1,000 positions with the plays shuffled, its error rate changed by +1.9 (95% interval −0.2 to +4.2), so the effect is not proven.

How many different plays the setups chose
Positions by the number of different plays chosen
Different plays chosenPositions
176
2256
3238
4214
5131
665
714
85
101

Shared positions

Analysis pendingwaits for the shared-position answers