Hilde · Decision models · answer key v2

Grammar · topic 13

The roles of words and phrases in a sentence

145 scored questions. Accuracy by topic compares this topic with the others.

Every setup's result

Accuracy on this topic's questions, with its 95% interval. Few questions make wide intervals.

SetupAccuracyRight
Gemini 3.8 Flashhigh reasoning · 16 questions per request · Chat model97.9%94.1% to 99.3%142 of 145
GPT-6 Astrahigh reasoning · 16 questions per request · Chat model97.9%94.1% to 99.3%142 of 145
GPT-6.1 Solhigh reasoning · 16 questions per request · Chat model97.9%94.1% to 99.3%142 of 145
GPT-6 Astralow reasoning · 16 questions per request · Chat model97.9%94.1% to 99.3%142 of 145
Gemini 3.8 Flashlow reasoning · 1 question per request · Chat model97.9%94.1% to 99.3%142 of 145
GPT-6.1 Sollow reasoning · 16 questions per request · Chat model97.9%94.1% to 99.3%142 of 145
GPT-6 Astralow reasoning · 1 question per request · Chat model97.2%93.1% to 98.9%141 of 145
GPT-6.1 Sollow reasoning · 1 question per request · Chat model97.2%93.1% to 98.9%141 of 145
Claude Opus 5.5high reasoning · 16 questions per request · Chat model97.2%93.1% to 98.9%141 of 145
Grok 4.7high reasoning · 16 questions per request · Chat model97.2%93.1% to 98.9%141 of 145
Gemini 4 Argonlow reasoning · 16 questions per request · Chat model95.9%91.3% to 98.1%139 of 145
Claude Fable 5.1high reasoning · 16 questions per request · Chat model95.9%91.3% to 98.1%139 of 145
Claude Opus 5.5low reasoning · 1 question per request · Chat model95.9%91.3% to 98.1%139 of 145
Claude Opus 5.5low reasoning · 16 questions per request · Chat model95.9%91.3% to 98.1%139 of 145
GPT-6.1 Terrahigh reasoning · 16 questions per request · Chat model95.2%90.4% to 97.6%138 of 145
DeepSeek-V4.1-Flash, first releasereasoning on · 16 questions per request · Chat model93.8%88.6% to 96.7%136 of 145
Gemini 3.8 Flashlow reasoning · 16 questions per request · Chat model89.7%83.6% to 93.6%130 of 145
GPT-6.1 Terralow reasoning · 16 questions per request · Chat model89.7%83.6% to 93.6%130 of 145
Claude Sonnet 5.5high reasoning · 1 question per request · Chat model89.7%83.6% to 93.6%130 of 145
Claude Sonnet 5.5high reasoning · 16 questions per request · Chat model89.7%83.6% to 93.6%130 of 145
GLM-5.3-Flashreasoning on · 16 questions per request · Chat model84.1%77.3% to 89.2%122 of 145
Kimi K3.1 Prolow reasoning · 16 questions per request · Chat model80.0%72.8% to 85.7%116 of 145
Qwen3.8-27Blow reasoning · 16 questions per request · Chat model79.3%72.0% to 85.1%115 of 145
GLM-5.3low reasoning · 16 questions per request · Chat model73.1%65.4% to 79.7%106 of 145
Liquid d1-ultra1 question per request · Decision model72.4%64.6% to 79.0%105 of 145
Fastino GLiDE1 question per request · Decision model67.6%59.6% to 74.7%98 of 145
Gemma 4 31Breasoning off · 16 questions per request · Chat model64.1%56.1% to 71.5%93 of 145
Kimi K3.1 Proreasoning none · 16 questions per request · Chat model61.4%53.3% to 68.9%89 of 145
vLLM-SR d31 question per request · Decision model58.6%50.5% to 66.3%85 of 145
vLLM-SR d3-ultratransformers, rev 52ba9e7 · 1 question per request · Decision model58.6%50.5% to 66.3%85 of 145
Fastino GLiDE v1.2local · 1 question per request · Decision model57.9%49.8% to 65.7%84 of 145
Liquid d1.11 question per request · Decision model57.2%49.1% to 65.0%83 of 145
Perplexity Decider 27B v1.2local · 1 question per request · Decision model54.5%46.4% to 62.4%79 of 145
SubQ Snap Preview1 question per request · Decision model54.5%46.4% to 62.4%79 of 145
GPT-6 Lunalow reasoning · 16 questions per request · Chat model53.8%45.7% to 61.7%78 of 145
Drex Max 1.11 question per request · Decision model53.8%45.7% to 61.7%78 of 145
Perplexity Decider 27B v1.11 question per request · Decision model53.1%45.0% to 61.0%77 of 145
Mammoth-11 question per request · Decision model52.4%44.3% to 60.4%76 of 145
Drex Max v11 question per request · Decision model51.7%43.7% to 59.7%75 of 145
GPT-6 LunaDecisions API, beta · 1 question per request · Decision model51.0%43.0% to 59.0%74 of 145
SubQ Snap 1.11 question per request · Decision model50.3%42.3% to 58.4%73 of 145
Gemma 4 31Breasoning off · 1 question per request · Chat model48.3%40.3% to 56.3%70 of 145
DeepSeek-V4.1-Flash, first releasereasoning off · 16 questions per request · Chat model47.6%39.6% to 55.7%69 of 145
Celeris-1 Decision1 question per request · Decision model45.5%37.6% to 53.6%66 of 145
Jev 1.14.01 question per request · Decision model45.5%37.6% to 53.6%66 of 145
Liquid d11 question per request · Decision model45.5%37.6% to 53.6%66 of 145
Jev 1.13.01 question per request · Decision model44.8%37.0% to 53.0%65 of 145
Claude Sonnet 5.5low reasoning · 16 questions per request · Chat model44.1%36.3% to 52.3%64 of 145
Perplexity Decider 27B v11 question per request · Decision model44.1%36.3% to 52.3%64 of 145
OneJev 27B1 question per request · Decision model44.1%36.3% to 52.3%64 of 145
Qwen3.8-27Bstated confidence · reasoning off · 1 question per request · Chat model42.8%35.0% to 50.9%62 of 145
Drex 2.01 question per request · Decision model42.1%34.3% to 50.2%61 of 145
Qwen3.8-27Bvote share · reasoning off · 1 question per request · Chat model40.7%33.0% to 48.8%59 of 145
Open-Jev 27B v1.11 question per request · Decision model40.0%32.4% to 48.1%58 of 145
Winnow-12B1 question per request · Decision model40.0%32.4% to 48.1%58 of 145
Elephant-11 question per request · Decision model39.3%31.7% to 47.4%57 of 145
Inception Mercury Decidevia OpenRouter · 1 question per request · Decision model38.6%31.1% to 46.7%56 of 145
GLM-5.3-Flashreasoning off · 16 questions per request · Chat model38.6%31.1% to 46.7%56 of 145
Qwen3.8-27Byes/no scoring · 1 question per request · Chat model37.9%30.4% to 46.0%55 of 145
Cygnet1 question per request · Decision model37.2%29.8% to 45.3%54 of 145
Clef1 question per request · Decision model34.5%27.2% to 42.5%50 of 145
Perplexity Decider Flash v1.2local · 1 question per request · Decision model33.1%26.0% to 41.1%48 of 145
Microsoft-Decision-1via OpenRouter · 1 question per request · Decision model32.4%25.3% to 40.4%47 of 145
Clef-flash1 question per request · Decision model32.4%25.3% to 40.4%47 of 145
Metask-Jev 4B1 question per request · Decision model28.3%21.6% to 36.1%41 of 145
Liquid d1-2B (open weights)1 question per request · Decision model26.9%20.3% to 34.6%39 of 145
Erk-14Breasoning off · 16 questions per request · Chat model26.2%19.7% to 33.9%38 of 145
Qwen3-14Breasoning off · 16 questions per request · Chat model25.5%19.1% to 33.2%37 of 145
GLiNER2.5-multi-Decide1 question per request · Decision model25.5%19.1% to 33.2%37 of 145
meraGPT Decider 11 question per request · Decision model24.8%18.5% to 32.4%36 of 145
Laya1 question per request · Decision model22.8%16.7% to 30.2%33 of 145
GLiNER2.5 Multi (base)1 question per request · Chat model18.6%13.1% to 25.7%27 of 145
Strands Decider 2B1 question per request · Decision model17.9%12.5% to 25.0%26 of 145
Laya multilingual1 question per request · Decision model16.6%11.4% to 23.4%24 of 145

Its questions

IDPageNumberAnswer keySetups rightDecision models right
11912527E33 of 7412 of 37
119225210D61 of 7427 of 37
119325211E65 of 7428 of 37
11942528D24 of 741 of 37
119525212E52 of 7424 of 37
11962529B29 of 744 of 37
119725213E60 of 7428 of 37
11982531D26 of 745 of 37
11992535B59 of 7429 of 37
12002532C65 of 7430 of 37
12012536E67 of 7433 of 37
12022533B44 of 7415 of 37
12032537C64 of 7429 of 37
12042534D45 of 7416 of 37
12122551C50 of 7419 of 37
12132554E62 of 7430 of 37
12142552D46 of 7417 of 37
12152555C41 of 7415 of 37
12162553B32 of 744 of 37
12172556B29 of 746 of 37
12482611A50 of 7417 of 37
12492614A42 of 7416 of 37
12502615E34 of 748 of 37
12512612B35 of 748 of 37
12522616D47 of 7418 of 37
12532613B34 of 747 of 37
12662647C41 of 7410 of 37
126726410D49 of 7422 of 37
126826411E42 of 7411 of 37
12692648E67 of 7433 of 37
127026412C29 of 744 of 37
12712649C67 of 7431 of 37
12842671C59 of 7426 of 37
12852674D50 of 7420 of 37
12862672E60 of 7427 of 37
12872675E33 of 749 of 37
12882673A54 of 7422 of 37
12892689B27 of 741 of 37
12902686D60 of 7427 of 37
129126810A36 of 7411 of 37
12922687C26 of 740 of 37
129326811E51 of 7423 of 37
12942688C44 of 7419 of 37
13012707D60 of 7428 of 37
130227010C19 of 747 of 37
130327011C57 of 7427 of 37
13042708E30 of 7411 of 37
13052709A36 of 747 of 37
130627012D40 of 7410 of 37
13072711D43 of 7411 of 37
13082714D42 of 7416 of 37
13092715C20 of 743 of 37
13102712D47 of 7418 of 37
13112716D65 of 7432 of 37
13122713E68 of 7432 of 37
36982511E18 of 749 of 37
36992514C24 of 746 of 37
37002512D47 of 7418 of 37
37012515B62 of 7427 of 37
37022513E41 of 7417 of 37
37032516C46 of 7419 of 37
37042548A42 of 7416 of 37
370525411C53 of 7420 of 37
370625412B22 of 748 of 37
37072549A65 of 7429 of 37
370825413D35 of 746 of 37
370925410B55 of 7425 of 37
371025414E36 of 749 of 37
37112567C50 of 7422 of 37
371225610D26 of 746 of 37
37132568E59 of 7429 of 37
371425611D45 of 7416 of 37
37152569A26 of 743 of 37
371625612C48 of 7416 of 37
37172571B41 of 7412 of 37
37182574D47 of 7412 of 37
37192575E58 of 7432 of 37
37202572B37 of 749 of 37
37212576D40 of 7413 of 37
37222573E42 of 7415 of 37
37232587B39 of 7412 of 37
372425810A62 of 7427 of 37
372525811A52 of 7423 of 37
37262588D48 of 7419 of 37
37272589D38 of 7411 of 37
372825812C24 of 743 of 37
37292591A33 of 747 of 37
37302594D52 of 7420 of 37
37312592B22 of 740 of 37
37322595B46 of 7422 of 37
37332593A65 of 7430 of 37
37342596A38 of 7414 of 37
37352607E51 of 7421 of 37
373626010C31 of 744 of 37
37372608E66 of 7433 of 37
373826011E58 of 7428 of 37
37392609A32 of 745 of 37
374026012B53 of 7425 of 37
37412627E35 of 749 of 37
374226210A35 of 748 of 37
374326211C51 of 7422 of 37
37442628C26 of 745 of 37
374526212A68 of 7432 of 37
37462629B51 of 7419 of 37
37472631B47 of 7419 of 37
37482634E22 of 744 of 37
37492632D30 of 744 of 37
37502635B57 of 7425 of 37
37512633C46 of 7416 of 37
37522636C52 of 7422 of 37
37532651E4 of 742 of 37
37542654E46 of 7416 of 37
37552652B23 of 740 of 37
37562655B38 of 747 of 37
37572653E59 of 7429 of 37
37582656D63 of 7430 of 37
37592667D52 of 7423 of 37
376026610C36 of 748 of 37
37612668B42 of 7414 of 37
376226611B30 of 744 of 37
376326612E22 of 744 of 37
37642669B38 of 7411 of 37
37652691B33 of 748 of 37
37662694A24 of 744 of 37
37672692D61 of 7427 of 37
37682695C41 of 7418 of 37
37692696B42 of 7416 of 37
37702693E32 of 746 of 37
37712727D43 of 7411 of 37
377227210C69 of 7434 of 37
37732728D30 of 745 of 37
377427211A46 of 7420 of 37
377527212E33 of 747 of 37
37762729E71 of 7435 of 37
37772731B33 of 7410 of 37
37782733C54 of 7420 of 37
37792734B43 of 7414 of 37
37802732B22 of 741 of 37
37812735C25 of 741 of 37
37822746B18 of 742 of 37
37832749B44 of 7417 of 37
378427410D50 of 7417 of 37
37852747E47 of 7419 of 37
378627411E40 of 7413 of 37
37872748E69 of 7434 of 37