Compare

Compare two setups

Two models, or one model at two reasoning settings, side by side, paired on the same positions.

Results f24d1f41, updated 16 November 2026, 22:20 UTC; scored by GNU Backgammon 1.08, 2-ply.

Shared positions

Analysis pending

Waits for the shared-position answers. League games give each setup different positions, so league setups cannot be paired; see each league's own tables on the Leagues page.

Earlier version: the v1 set

Earlier version
Earlier version: plays were listed in the runner's order, which tends to put the best play early. *

When Gemini 4 Argon answered the same 1,000 positions with the plays shuffled, its error rate changed by +1.9 (95% interval −0.2 to +4.2), so the effect is not proven.