Hilde · Decision models · answer key v2

Grammar · topic 18

Spelling

133 scored questions. Accuracy by topic compares this topic with the others.

Every setup's result

Accuracy on this topic's questions, with its 95% interval. Few questions make wide intervals.

SetupAccuracyRight
Gemini 3.8 Flashhigh reasoning · 16 questions per request · Chat model100.0%97.2% to 100.0%133 of 133
GPT-6 Astralow reasoning · 1 question per request · Chat model100.0%97.2% to 100.0%133 of 133
GPT-6 Astrahigh reasoning · 16 questions per request · Chat model99.2%95.9% to 99.9%132 of 133
GPT-6.1 Solhigh reasoning · 16 questions per request · Chat model99.2%95.9% to 99.9%132 of 133
GPT-6 Astralow reasoning · 16 questions per request · Chat model99.2%95.9% to 99.9%132 of 133
GPT-6.1 Sollow reasoning · 1 question per request · Chat model98.5%94.7% to 99.6%131 of 133
Gemini 4 Argonlow reasoning · 16 questions per request · Chat model98.5%94.7% to 99.6%131 of 133
Gemini 3.8 Flashlow reasoning · 1 question per request · Chat model97.7%93.6% to 99.2%130 of 133
GPT-6.1 Sollow reasoning · 16 questions per request · Chat model97.7%93.6% to 99.2%130 of 133
Claude Fable 5.1high reasoning · 16 questions per request · Chat model96.2%91.5% to 98.4%128 of 133
Gemini 3.8 Flashlow reasoning · 16 questions per request · Chat model96.2%91.5% to 98.4%128 of 133
GPT-6.1 Terrahigh reasoning · 16 questions per request · Chat model94.7%89.5% to 97.4%126 of 133
DeepSeek-V4.1-Flash, first releasereasoning on · 16 questions per request · Chat model94.0%88.6% to 96.9%125 of 133
Claude Opus 5.5high reasoning · 16 questions per request · Chat model90.2%84.0% to 94.2%120 of 133
GPT-6.1 Terralow reasoning · 16 questions per request · Chat model90.2%84.0% to 94.2%120 of 133
Grok 4.7high reasoning · 16 questions per request · Chat model86.5%79.6% to 91.3%115 of 133
Claude Opus 5.5low reasoning · 1 question per request · Chat model85.0%77.9% to 90.0%113 of 133
Claude Opus 5.5low reasoning · 16 questions per request · Chat model83.5%76.2% to 88.8%111 of 133
GPT-6 Lunalow reasoning · 16 questions per request · Chat model82.0%74.6% to 87.6%109 of 133
Kimi K3.1 Prolow reasoning · 16 questions per request · Chat model77.4%69.6% to 83.7%103 of 133
Claude Sonnet 5.5high reasoning · 1 question per request · Chat model76.7%68.8% to 83.1%102 of 133
DeepSeek-V4.1-Flash, first releasereasoning off · 16 questions per request · Chat model76.7%68.8% to 83.1%102 of 133
Claude Sonnet 5.5high reasoning · 16 questions per request · Chat model75.9%68.0% to 82.4%101 of 133
GPT-6 LunaDecisions API, beta · 1 question per request · Decision model75.9%68.0% to 82.4%101 of 133
Gemma 4 31Breasoning off · 16 questions per request · Chat model73.7%65.6% to 80.4%98 of 133
Kimi K3.1 Proreasoning none · 16 questions per request · Chat model72.9%64.8% to 79.8%97 of 133
Gemma 4 31Breasoning off · 1 question per request · Chat model69.9%61.7% to 77.1%93 of 133
Claude Sonnet 5.5low reasoning · 16 questions per request · Chat model69.9%61.7% to 77.1%93 of 133
Liquid d1-ultra1 question per request · Decision model68.4%60.1% to 75.7%91 of 133
GLM-5.3low reasoning · 16 questions per request · Chat model66.9%58.5% to 74.3%89 of 133
Qwen3.8-27Blow reasoning · 16 questions per request · Chat model65.4%57.0% to 73.0%87 of 133
GLM-5.3-Flashreasoning on · 16 questions per request · Chat model64.7%56.2% to 72.3%86 of 133
Perplexity Decider 27B v1.11 question per request · Decision model62.4%53.9% to 70.2%83 of 133
Drex Max 1.11 question per request · Decision model61.7%53.2% to 69.5%82 of 133
vLLM-SR d3-ultratransformers, rev 52ba9e7 · 1 question per request · Decision model60.9%52.4% to 68.8%81 of 133
Perplexity Decider 27B v1.2local · 1 question per request · Decision model60.9%52.4% to 68.8%81 of 133
Fastino GLiDE v1.2local · 1 question per request · Decision model60.2%51.7% to 68.1%80 of 133
Fastino GLiDE1 question per request · Decision model60.2%51.7% to 68.1%80 of 133
vLLM-SR d31 question per request · Decision model59.4%50.9% to 67.4%79 of 133
Drex Max v11 question per request · Decision model59.4%50.9% to 67.4%79 of 133
SubQ Snap 1.11 question per request · Decision model59.4%50.9% to 67.4%79 of 133
Mammoth-11 question per request · Decision model57.9%49.4% to 65.9%77 of 133
GLM-5.3-Flashreasoning off · 16 questions per request · Chat model57.1%48.6% to 65.2%76 of 133
SubQ Snap Preview1 question per request · Decision model55.6%47.2% to 63.8%74 of 133
Clef1 question per request · Decision model52.6%44.2% to 60.9%70 of 133
Open-Jev 27B v1.11 question per request · Decision model51.9%43.5% to 60.2%69 of 133
Inception Mercury Decidevia OpenRouter · 1 question per request · Decision model51.1%42.7% to 59.5%68 of 133
Liquid d1.11 question per request · Decision model50.4%42.0% to 58.7%67 of 133
Perplexity Decider 27B v11 question per request · Decision model50.4%42.0% to 58.7%67 of 133
Qwen3.8-27Bvote share · reasoning off · 1 question per request · Chat model50.4%42.0% to 58.7%67 of 133
OneJev 27B1 question per request · Decision model49.6%41.3% to 58.0%66 of 133
Qwen3.8-27Bstated confidence · reasoning off · 1 question per request · Chat model48.1%39.8% to 56.5%64 of 133
Winnow-12B1 question per request · Decision model47.4%39.1% to 55.8%63 of 133
Qwen3.8-27Byes/no scoring · 1 question per request · Chat model46.6%38.4% to 55.1%62 of 133
Liquid d11 question per request · Decision model45.9%37.6% to 54.3%61 of 133
Cygnet1 question per request · Decision model45.9%37.6% to 54.3%61 of 133
Celeris-1 Decision1 question per request · Decision model45.1%36.9% to 53.6%60 of 133
Drex 2.01 question per request · Decision model45.1%36.9% to 53.6%60 of 133
Jev 1.14.01 question per request · Decision model41.4%33.3% to 49.9%55 of 133
Jev 1.13.01 question per request · Decision model39.1%31.2% to 47.6%52 of 133
Elephant-11 question per request · Decision model38.3%30.5% to 46.8%51 of 133
Qwen3-14Breasoning off · 16 questions per request · Chat model37.6%29.8% to 46.1%50 of 133
Erk-14Breasoning off · 16 questions per request · Chat model36.1%28.4% to 44.5%48 of 133
Microsoft-Decision-1via OpenRouter · 1 question per request · Decision model33.1%25.7% to 41.5%44 of 133
Perplexity Decider Flash v1.2local · 1 question per request · Decision model31.6%24.3% to 39.9%42 of 133
Clef-flash1 question per request · Decision model30.1%22.9% to 38.3%40 of 133
Metask-Jev 4B1 question per request · Decision model27.1%20.2% to 35.2%36 of 133
Strands Decider 2B1 question per request · Decision model26.3%19.6% to 34.4%35 of 133
Laya multilingual1 question per request · Decision model21.8%15.6% to 29.6%29 of 133
meraGPT Decider 11 question per request · Decision model21.1%15.0% to 28.7%28 of 133
Liquid d1-2B (open weights)1 question per request · Decision model20.3%14.3% to 27.9%27 of 133
GLiNER2.5-multi-Decide1 question per request · Decision model19.5%13.7% to 27.1%26 of 133
Laya1 question per request · Decision model16.5%11.2% to 23.8%22 of 133
GLiNER2.5 Multi (base)1 question per request · Chat model13.5%8.7% to 20.4%18 of 133

Its questions

IDPageNumberAnswer keySetups rightDecision models right
27093707C18 of 743 of 37
271037010A26 of 741 of 37
271137011E58 of 7425 of 37
27123708C60 of 7428 of 37
271337012E48 of 7422 of 37
27143709E34 of 746 of 37
271537013C60 of 7425 of 37
40223511B55 of 7428 of 37
40233514D26 of 748 of 37
40243512E15 of 744 of 37
40253515D48 of 7415 of 37
40263513C61 of 7427 of 37
40273526A44 of 7414 of 37
40283529C63 of 7429 of 37
402935210D67 of 7431 of 37
40303527D55 of 7426 of 37
403135211A35 of 7415 of 37
403235212B70 of 7434 of 37
40333528C58 of 7428 of 37
40343531D36 of 747 of 37
40353534E38 of 748 of 37
40363532E48 of 7416 of 37
40373535E48 of 7418 of 37
40383533B68 of 7431 of 37
40393536A62 of 7427 of 37
40403547E61 of 7427 of 37
404135410B61 of 7428 of 37
40423548C16 of 742 of 37
404335411E68 of 7432 of 37
404435412D50 of 7420 of 37
40453549A27 of 745 of 37
40463554B27 of 742 of 37
40473551C64 of 7429 of 37
40483555C33 of 746 of 37
40493552E24 of 746 of 37
40503556C52 of 7420 of 37
40513553E40 of 7411 of 37
405235610D42 of 7420 of 37
40533567B48 of 7414 of 37
405435611D65 of 7429 of 37
40553568E43 of 7416 of 37
40563569E54 of 7422 of 37
405735612C21 of 741 of 37
40583574E54 of 7422 of 37
40593571E35 of 7410 of 37
40603572B40 of 749 of 37
40613575A41 of 749 of 37
40623573C31 of 746 of 37
40633576C64 of 7429 of 37
40643587D50 of 7420 of 37
406535810A48 of 7418 of 37
40663588B32 of 745 of 37
406735811A45 of 7420 of 37
40683589A21 of 743 of 37
406935812A51 of 7424 of 37
40703591E42 of 7416 of 37
40713594C27 of 742 of 37
40723592A54 of 7419 of 37
40733595C67 of 7431 of 37
40743593B28 of 743 of 37
40753596E61 of 7427 of 37
407636010A57 of 7426 of 37
40773607E50 of 7428 of 37
407836011E36 of 7413 of 37
40793608D32 of 7410 of 37
408036012D60 of 7426 of 37
40813609E24 of 745 of 37
40823611D21 of 742 of 37
40833614A49 of 7421 of 37
40843612D61 of 7425 of 37
40853615D46 of 7418 of 37
40863613A50 of 7418 of 37
40873616A19 of 744 of 37
40883627E35 of 7414 of 37
408936210C36 of 749 of 37
40903628B39 of 7413 of 37
409136211A35 of 749 of 37
40923629E36 of 748 of 37
409336212B28 of 7411 of 37
40943631C58 of 7425 of 37
40953634C50 of 7418 of 37
40963635A48 of 7417 of 37
40973632C66 of 7430 of 37
40983636D21 of 740 of 37
40993633E59 of 7425 of 37
41003647B19 of 745 of 37
410136410B50 of 7415 of 37
410236411D60 of 7426 of 37
41033648A68 of 7432 of 37
41043649D68 of 7432 of 37
410536412B63 of 7426 of 37
41063651B52 of 7422 of 37
41073654B29 of 741 of 37
41083652E44 of 7416 of 37
41093655B57 of 7424 of 37
41103653D61 of 7425 of 37
41113656A23 of 743 of 37
411236610C66 of 7430 of 37
41133667C49 of 7416 of 37
41143668D30 of 748 of 37
411636612B46 of 7418 of 37
41173669B29 of 742 of 37
41183671C62 of 7428 of 37
41193674A33 of 749 of 37
41203672C43 of 7412 of 37
41213675E41 of 7416 of 37
41223676E41 of 7411 of 37
41233673B38 of 7414 of 37
41243687B41 of 7412 of 37
412536810C53 of 7421 of 37
412636811C35 of 749 of 37
41273688B48 of 7414 of 37
412836812B59 of 7424 of 37
41293689C57 of 7422 of 37
41303691D53 of 7418 of 37
41313694D59 of 7428 of 37
41323695D61 of 7429 of 37
41333692C60 of 7425 of 37
41343693C19 of 743 of 37
41353696A60 of 7426 of 37
41363711A24 of 743 of 37
41373714E57 of 7423 of 37
41383715C24 of 747 of 37
41393712D68 of 7433 of 37
41403716C11 of 741 of 37
41413713C67 of 7433 of 37
41423727E58 of 7425 of 37
414337210D61 of 7428 of 37
414437211D39 of 7410 of 37
41453728E44 of 7415 of 37
414637212A40 of 7410 of 37
41473729B44 of 7413 of 37
414837213B63 of 7429 of 37