Hilde · Decision models · answer key v2

Grammar · topic 15

Types of sentences

85 scored questions. Accuracy by topic compares this topic with the others.

Every setup's result

Accuracy on this topic's questions, with its 95% interval. Few questions make wide intervals.

SetupAccuracyRight
Gemini 3.8 Flashhigh reasoning · 16 questions per request · Chat model98.8%93.6% to 99.8%84 of 85
GPT-6 Astrahigh reasoning · 16 questions per request · Chat model98.8%93.6% to 99.8%84 of 85
GPT-6.1 Solhigh reasoning · 16 questions per request · Chat model98.8%93.6% to 99.8%84 of 85
GPT-6 Astralow reasoning · 16 questions per request · Chat model98.8%93.6% to 99.8%84 of 85
GPT-6 Astralow reasoning · 1 question per request · Chat model98.8%93.6% to 99.8%84 of 85
GPT-6.1 Sollow reasoning · 1 question per request · Chat model98.8%93.6% to 99.8%84 of 85
Claude Fable 5.1high reasoning · 16 questions per request · Chat model98.8%93.6% to 99.8%84 of 85
Gemini 3.8 Flashlow reasoning · 1 question per request · Chat model97.6%91.8% to 99.4%83 of 85
GPT-6.1 Terrahigh reasoning · 16 questions per request · Chat model97.6%91.8% to 99.4%83 of 85
GPT-6.1 Sollow reasoning · 16 questions per request · Chat model96.5%90.1% to 98.8%82 of 85
Gemini 4 Argonlow reasoning · 16 questions per request · Chat model96.5%90.1% to 98.8%82 of 85
Claude Opus 5.5high reasoning · 16 questions per request · Chat model95.3%88.5% to 98.2%81 of 85
Grok 4.7high reasoning · 16 questions per request · Chat model95.3%88.5% to 98.2%81 of 85
DeepSeek-V4.1-Flash, first releasereasoning on · 16 questions per request · Chat model95.3%88.5% to 98.2%81 of 85
GPT-6.1 Terralow reasoning · 16 questions per request · Chat model94.1%87.0% to 97.5%80 of 85
Claude Sonnet 5.5high reasoning · 1 question per request · Chat model94.1%87.0% to 97.5%80 of 85
Gemini 3.8 Flashlow reasoning · 16 questions per request · Chat model92.9%85.4% to 96.7%79 of 85
Claude Opus 5.5low reasoning · 16 questions per request · Chat model92.9%85.4% to 96.7%79 of 85
Claude Opus 5.5low reasoning · 1 question per request · Chat model91.8%84.0% to 96.0%78 of 85
Claude Sonnet 5.5high reasoning · 16 questions per request · Chat model90.6%82.5% to 95.2%77 of 85
GLM-5.3-Flashreasoning on · 16 questions per request · Chat model84.7%75.6% to 90.8%72 of 85
Kimi K3.1 Prolow reasoning · 16 questions per request · Chat model81.2%71.6% to 88.1%69 of 85
Qwen3.8-27Blow reasoning · 16 questions per request · Chat model77.6%67.7% to 85.2%66 of 85
Liquid d1-ultra1 question per request · Decision model75.3%65.2% to 83.2%64 of 85
GLM-5.3low reasoning · 16 questions per request · Chat model75.3%65.2% to 83.2%64 of 85
vLLM-SR d3-ultratransformers, rev 52ba9e7 · 1 question per request · Decision model69.4%59.0% to 78.2%59 of 85
Gemma 4 31Breasoning off · 16 questions per request · Chat model68.2%57.7% to 77.2%58 of 85
Kimi K3.1 Proreasoning none · 16 questions per request · Chat model68.2%57.7% to 77.2%58 of 85
Drex Max 1.11 question per request · Decision model65.9%55.3% to 75.1%56 of 85
GPT-6 Lunalow reasoning · 16 questions per request · Chat model64.7%54.1% to 74.0%55 of 85
Drex Max v11 question per request · Decision model64.7%54.1% to 74.0%55 of 85
Fastino GLiDE1 question per request · Decision model63.5%52.9% to 73.0%54 of 85
Fastino GLiDE v1.2local · 1 question per request · Decision model62.4%51.7% to 71.9%53 of 85
vLLM-SR d31 question per request · Decision model62.4%51.7% to 71.9%53 of 85
Perplexity Decider 27B v1.11 question per request · Decision model61.2%50.5% to 70.8%52 of 85
Perplexity Decider 27B v1.2local · 1 question per request · Decision model60.0%49.4% to 69.8%51 of 85
GPT-6 LunaDecisions API, beta · 1 question per request · Decision model57.6%47.0% to 67.6%49 of 85
Perplexity Decider 27B v11 question per request · Decision model57.6%47.0% to 67.6%49 of 85
SubQ Snap Preview1 question per request · Decision model56.5%45.9% to 66.5%48 of 85
SubQ Snap 1.11 question per request · Decision model56.5%45.9% to 66.5%48 of 85
Celeris-1 Decision1 question per request · Decision model56.5%45.9% to 66.5%48 of 85
DeepSeek-V4.1-Flash, first releasereasoning off · 16 questions per request · Chat model54.1%43.6% to 64.3%46 of 85
Mammoth-11 question per request · Decision model51.8%41.3% to 62.1%44 of 85
OneJev 27B1 question per request · Decision model51.8%41.3% to 62.1%44 of 85
Gemma 4 31Breasoning off · 1 question per request · Chat model50.6%40.2% to 61.0%43 of 85
Liquid d1.11 question per request · Decision model50.6%40.2% to 61.0%43 of 85
Jev 1.14.01 question per request · Decision model50.6%40.2% to 61.0%43 of 85
Clef1 question per request · Decision model49.4%39.0% to 59.8%42 of 85
Claude Sonnet 5.5low reasoning · 16 questions per request · Chat model48.2%37.9% to 58.7%41 of 85
Jev 1.13.01 question per request · Decision model48.2%37.9% to 58.7%41 of 85
Liquid d11 question per request · Decision model47.1%36.8% to 57.6%40 of 85
Inception Mercury Decidevia OpenRouter · 1 question per request · Decision model45.9%35.7% to 56.4%39 of 85
GLM-5.3-Flashreasoning off · 16 questions per request · Chat model44.7%34.6% to 55.3%38 of 85
Qwen3.8-27Bvote share · reasoning off · 1 question per request · Chat model43.5%33.5% to 54.1%37 of 85
Drex 2.01 question per request · Decision model42.4%32.4% to 53.0%36 of 85
Open-Jev 27B v1.11 question per request · Decision model41.2%31.3% to 51.8%35 of 85
Qwen3.8-27Bstated confidence · reasoning off · 1 question per request · Chat model41.2%31.3% to 51.8%35 of 85
Cygnet1 question per request · Decision model40.0%30.2% to 50.6%34 of 85
Winnow-12B1 question per request · Decision model38.8%29.2% to 49.5%33 of 85
Perplexity Decider Flash v1.2local · 1 question per request · Decision model36.5%27.0% to 47.1%31 of 85
Elephant-11 question per request · Decision model31.8%22.8% to 42.3%27 of 85
Qwen3.8-27Byes/no scoring · 1 question per request · Chat model31.8%22.8% to 42.3%27 of 85
Qwen3-14Breasoning off · 16 questions per request · Chat model31.8%22.8% to 42.3%27 of 85
Clef-flash1 question per request · Decision model30.6%21.8% to 41.0%26 of 85
Microsoft-Decision-1via OpenRouter · 1 question per request · Decision model29.4%20.8% to 39.8%25 of 85
Erk-14Breasoning off · 16 questions per request · Chat model29.4%20.8% to 39.8%25 of 85
Laya1 question per request · Decision model27.1%18.8% to 37.3%23 of 85
Liquid d1-2B (open weights)1 question per request · Decision model25.9%17.8% to 36.1%22 of 85
Metask-Jev 4B1 question per request · Decision model24.7%16.8% to 34.8%21 of 85
GLiNER2.5 Multi (base)1 question per request · Chat model22.4%14.8% to 32.3%19 of 85
Strands Decider 2B1 question per request · Decision model20.0%12.9% to 29.7%17 of 85
Laya multilingual1 question per request · Decision model20.0%12.9% to 29.7%17 of 85
GLiNER2.5-multi-Decide1 question per request · Decision model17.6%11.0% to 27.1%15 of 85
meraGPT Decider 11 question per request · Decision model15.3%9.2% to 24.4%13 of 85

Its questions

IDPageNumberAnswer keySetups rightDecision models right
14042871B46 of 7415 of 37
14052874D71 of 7436 of 37
14062875B61 of 7429 of 37
14072872C62 of 7427 of 37
14082876A46 of 7418 of 37
14092873E36 of 7411 of 37
141028810D36 of 7411 of 37
14112887C30 of 742 of 37
141228811E53 of 7424 of 37
14132888A46 of 7415 of 37
141428812B46 of 7417 of 37
14152889C58 of 7423 of 37
14162891D33 of 748 of 37
14172894E37 of 749 of 37
14182895C58 of 7424 of 37
14192892C68 of 7432 of 37
14202896A48 of 7419 of 37
14212893E52 of 7427 of 37
14222897C40 of 7412 of 37
14232908E65 of 7432 of 37
142429011A45 of 7416 of 37
14252909D63 of 7429 of 37
142629012C58 of 7425 of 37
142729010B53 of 7424 of 37
142829013E56 of 7423 of 37
14292914E45 of 7415 of 37
14302911B58 of 7425 of 37
14312915A39 of 7411 of 37
14322912C28 of 744 of 37
14332916D32 of 744 of 37
14342913C31 of 7410 of 37
14352927C47 of 7421 of 37
143629210D28 of 745 of 37
14372928D64 of 7429 of 37
143829211B46 of 7415 of 37
143929212A54 of 7427 of 37
14402929E40 of 7415 of 37
22612951D44 of 7416 of 37
22622954E44 of 7419 of 37
22632952C46 of 7422 of 37
22642955B39 of 7411 of 37
22652953B30 of 745 of 37
22662956A59 of 7429 of 37
22732971D39 of 747 of 37
22742974B33 of 7411 of 37
22752975E44 of 7419 of 37
22762972D38 of 746 of 37
22772976E37 of 7413 of 37
22782973C46 of 7415 of 37
22792987B5 of 743 of 37
228029810D22 of 742 of 37
22812988C58 of 7423 of 37
228229811B43 of 7413 of 37
228329812E43 of 7414 of 37
22842989A64 of 7431 of 37
22852991A68 of 7433 of 37
22862994C66 of 7430 of 37
22872992B31 of 745 of 37
22882995E61 of 7430 of 37
22892996B24 of 740 of 37
22902993D33 of 749 of 37
229130010C32 of 747 of 37
22923007A42 of 7415 of 37
22933008B36 of 7413 of 37
229430011B27 of 748 of 37
22953009E20 of 744 of 37
229630012D38 of 7414 of 37
38142934D48 of 7419 of 37
38152931A31 of 745 of 37
38162935B63 of 7427 of 37
38172932E34 of 747 of 37
38182936C58 of 7423 of 37
38192933B33 of 746 of 37
38202947E42 of 7416 of 37
382129410A49 of 7421 of 37
382229411E38 of 7410 of 37
38232948C65 of 7431 of 37
382429412D51 of 7425 of 37
38252949D34 of 747 of 37
38262967B53 of 7422 of 37
382729610B36 of 746 of 37
382829611A63 of 7430 of 37
38292968E49 of 7421 of 37
383029612C64 of 7429 of 37
38312969A62 of 7429 of 37