Hilde · Decision models · answer key v2

Reading · topic 3

How a writer explains and develops ideas

70 scored questions. Accuracy by topic compares this topic with the others.

Every setup's result

Accuracy on this topic's questions, with its 95% interval. Few questions make wide intervals.

SetupAccuracyRight
Gemini 3.8 Flashhigh reasoning · 16 questions per request · Chat model94.3%86.2% to 97.8%66 of 70
GPT-6 Astralow reasoning · 1 question per request · Chat model94.3%86.2% to 97.8%66 of 70
GPT-6 Astrahigh reasoning · 16 questions per request · Chat model92.9%84.3% to 96.9%65 of 70
GPT-6 Astralow reasoning · 16 questions per request · Chat model92.9%84.3% to 96.9%65 of 70
GPT-6.1 Solhigh reasoning · 16 questions per request · Chat model91.4%82.5% to 96.0%64 of 70
Gemini 3.8 Flashlow reasoning · 1 question per request · Chat model91.4%82.5% to 96.0%64 of 70
GPT-6.1 Sollow reasoning · 1 question per request · Chat model91.4%82.5% to 96.0%64 of 70
GPT-6.1 Sollow reasoning · 16 questions per request · Chat model91.4%82.5% to 96.0%64 of 70
Claude Fable 5.1high reasoning · 16 questions per request · Chat model91.4%82.5% to 96.0%64 of 70
GPT-6.1 Terrahigh reasoning · 16 questions per request · Chat model91.4%82.5% to 96.0%64 of 70
GPT-6.1 Terralow reasoning · 16 questions per request · Chat model91.4%82.5% to 96.0%64 of 70
Gemini 4 Argonlow reasoning · 16 questions per request · Chat model90.0%80.8% to 95.1%63 of 70
Claude Opus 5.5high reasoning · 16 questions per request · Chat model90.0%80.8% to 95.1%63 of 70
Gemini 3.8 Flashlow reasoning · 16 questions per request · Chat model88.6%79.0% to 94.1%62 of 70
Gemma 4 31Breasoning off · 16 questions per request · Chat model88.6%79.0% to 94.1%62 of 70
Gemma 4 31Breasoning off · 1 question per request · Chat model87.1%77.3% to 93.1%61 of 70
Claude Opus 5.5low reasoning · 1 question per request · Chat model85.7%75.7% to 92.1%60 of 70
Grok 4.7high reasoning · 16 questions per request · Chat model85.7%75.7% to 92.1%60 of 70
Claude Opus 5.5low reasoning · 16 questions per request · Chat model85.7%75.7% to 92.1%60 of 70
Liquid d1-ultra1 question per request · Decision model85.7%75.7% to 92.1%60 of 70
Fastino GLiDE v1.2local · 1 question per request · Decision model85.7%75.7% to 92.1%60 of 70
DeepSeek-V4.1-Flash, first releasereasoning on · 16 questions per request · Chat model84.3%74.0% to 91.0%59 of 70
Drex Max 1.11 question per request · Decision model84.3%74.0% to 91.0%59 of 70
Perplexity Decider 27B v1.2local · 1 question per request · Decision model84.3%74.0% to 91.0%59 of 70
Perplexity Decider 27B v1.11 question per request · Decision model84.3%74.0% to 91.0%59 of 70
Claude Sonnet 5.5high reasoning · 1 question per request · Chat model82.9%72.4% to 89.9%58 of 70
Kimi K3.1 Proreasoning none · 16 questions per request · Chat model82.9%72.4% to 89.9%58 of 70
Fastino GLiDE1 question per request · Decision model82.9%72.4% to 89.9%58 of 70
vLLM-SR d3-ultratransformers, rev 52ba9e7 · 1 question per request · Decision model82.9%72.4% to 89.9%58 of 70
Mammoth-11 question per request · Decision model82.9%72.4% to 89.9%58 of 70
Kimi K3.1 Prolow reasoning · 16 questions per request · Chat model81.4%70.8% to 88.8%57 of 70
vLLM-SR d31 question per request · Decision model81.4%70.8% to 88.8%57 of 70
Drex Max v11 question per request · Decision model81.4%70.8% to 88.8%57 of 70
Celeris-1 Decision1 question per request · Decision model81.4%70.8% to 88.8%57 of 70
DeepSeek-V4.1-Flash, first releasereasoning off · 16 questions per request · Chat model80.0%69.2% to 87.7%56 of 70
Perplexity Decider 27B v11 question per request · Decision model80.0%69.2% to 87.7%56 of 70
OneJev 27B1 question per request · Decision model80.0%69.2% to 87.7%56 of 70
GLM-5.3-Flashreasoning on · 16 questions per request · Chat model78.6%67.6% to 86.6%55 of 70
Qwen3.8-27Blow reasoning · 16 questions per request · Chat model78.6%67.6% to 86.6%55 of 70
SubQ Snap 1.11 question per request · Decision model78.6%67.6% to 86.6%55 of 70
Clef1 question per request · Decision model77.1%66.0% to 85.4%54 of 70
SubQ Snap Preview1 question per request · Decision model75.7%64.5% to 84.2%53 of 70
Liquid d1.11 question per request · Decision model75.7%64.5% to 84.2%53 of 70
Liquid d11 question per request · Decision model75.7%64.5% to 84.2%53 of 70
Drex 2.01 question per request · Decision model75.7%64.5% to 84.2%53 of 70
GLM-5.3low reasoning · 16 questions per request · Chat model74.3%63.0% to 83.1%52 of 70
GPT-6 Lunalow reasoning · 16 questions per request · Chat model74.3%63.0% to 83.1%52 of 70
Jev 1.14.01 question per request · Decision model74.3%63.0% to 83.1%52 of 70
Inception Mercury Decidevia OpenRouter · 1 question per request · Decision model74.3%63.0% to 83.1%52 of 70
Qwen3.8-27Bvote share · reasoning off · 1 question per request · Chat model74.3%63.0% to 83.1%52 of 70
Qwen3.8-27Bstated confidence · reasoning off · 1 question per request · Chat model74.3%63.0% to 83.1%52 of 70
GPT-6 LunaDecisions API, beta · 1 question per request · Decision model72.9%61.5% to 81.9%51 of 70
Qwen3.8-27Byes/no scoring · 1 question per request · Chat model72.9%61.5% to 81.9%51 of 70
Claude Sonnet 5.5low reasoning · 16 questions per request · Chat model71.4%59.9% to 80.7%50 of 70
Jev 1.13.01 question per request · Decision model71.4%59.9% to 80.7%50 of 70
Open-Jev 27B v1.11 question per request · Decision model71.4%59.9% to 80.7%50 of 70
Perplexity Decider Flash v1.2local · 1 question per request · Decision model70.0%58.5% to 79.5%49 of 70
Microsoft-Decision-1via OpenRouter · 1 question per request · Decision model70.0%58.5% to 79.5%49 of 70
Claude Sonnet 5.5high reasoning · 16 questions per request · Chat model68.6%57.0% to 78.2%48 of 70
Cygnet1 question per request · Decision model68.6%57.0% to 78.2%48 of 70
Elephant-11 question per request · Decision model68.6%57.0% to 78.2%48 of 70
Winnow-12B1 question per request · Decision model67.1%55.5% to 77.0%47 of 70
Qwen3-14Breasoning off · 16 questions per request · Chat model65.7%54.0% to 75.8%46 of 70
Erk-14Breasoning off · 16 questions per request · Chat model65.7%54.0% to 75.8%46 of 70
GLM-5.3-Flashreasoning off · 16 questions per request · Chat model62.9%51.1% to 73.2%44 of 70
Clef-flash1 question per request · Decision model60.0%48.3% to 70.7%42 of 70
Metask-Jev 4B1 question per request · Decision model54.3%42.7% to 65.4%38 of 70
Liquid d1-2B (open weights)1 question per request · Decision model38.6%28.0% to 50.3%27 of 70
meraGPT Decider 11 question per request · Decision model34.3%24.2% to 46.0%24 of 70
Strands Decider 2B1 question per request · Decision model32.9%23.0% to 44.5%23 of 70
GLiNER2.5-multi-Decide1 question per request · Decision model17.1%10.1% to 27.6%12 of 70
GLiNER2.5 Multi (base)1 question per request · Chat model17.1%10.1% to 27.6%12 of 70
Laya multilingual1 question per request · Decision model15.7%9.0% to 26.0%11 of 70
Laya1 question per request · Decision model11.4%5.9% to 21.0%8 of 70

Its questions

IDPageNumberAnswer keySetups rightDecision models right
289673B62 of 7429 of 37
290671B69 of 7433 of 37
291672C66 of 7432 of 37
292674D1 of 741 of 37
293685B70 of 7434 of 37
294687D68 of 7432 of 37
295688C67 of 7431 of 37
296686E60 of 7427 of 37
297691C71 of 7434 of 37
298693D70 of 7434 of 37
299692B42 of 7414 of 37
300694A70 of 7433 of 37
301705C70 of 7434 of 37
302708E70 of 7434 of 37
303706E72 of 7436 of 37
304709B67 of 7431 of 37
305707D66 of 7431 of 37
306711C67 of 7431 of 37
307713B25 of 7413 of 37
308712A70 of 7433 of 37
309714E68 of 7433 of 37
310725A58 of 7427 of 37
311727C39 of 7411 of 37
312728D6 of 743 of 37
313726E45 of 7417 of 37
314731B16 of 742 of 37
315733E58 of 7430 of 37
316734D37 of 7425 of 37
317732D52 of 7420 of 37
318745A68 of 7433 of 37
319747E56 of 7423 of 37
320746C64 of 7432 of 37
321748D28 of 748 of 37
322751C47 of 7421 of 37
323753A71 of 7434 of 37
324754B48 of 7421 of 37
325752D62 of 7429 of 37
326765E64 of 7429 of 37
327767A73 of 7436 of 37
328768B26 of 7411 of 37
329766D28 of 7410 of 37
330769C18 of 741 of 37
331771C70 of 7434 of 37
332773B60 of 7428 of 37
333774A61 of 7432 of 37
334772D27 of 745 of 37
335775D46 of 7417 of 37
336786D62 of 7430 of 37
337788C63 of 7427 of 37
338789B70 of 7434 of 37
339787E66 of 7431 of 37
3407810D43 of 7422 of 37
341791D70 of 7434 of 37
342793B19 of 743 of 37
343792E69 of 7433 of 37
344794C67 of 7431 of 37
350811D66 of 7431 of 37
351813C44 of 7419 of 37
352812B68 of 7432 of 37
353814E50 of 7420 of 37
354825B39 of 7414 of 37
355828E66 of 7430 of 37
356826E50 of 7422 of 37
357829D53 of 7420 of 37
3588210A64 of 7428 of 37
359827C70 of 7434 of 37
3183805B69 of 7433 of 37
3184807E65 of 7431 of 37
3186806D43 of 7418 of 37
3187809C65 of 7430 of 37