Math · I don't know

I don't know on Math

2,163 questions, asked in English. How to read this page · Method

Explicit “I don't know” option

Non-hallucination with “I don't know”

F among the answers that were not right (F / (F + wrong)), with F offered as a sixth option; beside it the share answered (right + wrong of N) and the error rate among the answers (wrong / (right + wrong)) · higher non-hallucination is better, read with the share answered

  1. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Non-hallucination with “I don't know” 87.4% · answered 61.2%

    Logic 54.9%

    Its run record (Method) →

    87.4%61.2%9.1%
  2. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 86.7% · answered 58.4%

    Logic 51.6%

    Its run record (Method) →

    86.7%58.4%10.9%
  3. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.9% · answered 62.1%

    Logic 47.3%

    Its run record (Method) →

    82.9%62.1%12.6%
  4. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.7% · answered 61.8%

    Logic 47.3%

    Its run record (Method) →

    82.7%61.8%12.9%
  5. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.5% · answered 55.9%

    Logic 46.0%

    Its run record (Method) →

    82.5%55.9%16.7%
  6. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Non-hallucination with “I don't know” 80.2% · answered 33.7%

    Logic 30.7%

    Its run record (Method) →

    80.2%33.7%48.6%
  7. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Non-hallucination with “I don't know” 72.8% · answered 32.5%

    Logic 23.2%

    Its run record (Method) →

    72.8%32.5%77.7%
  8. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 70.6% · answered 75.5%

    Logic 54.5%

    Its run record (Method) →

    70.6%75.5%13.5%
  9. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 65.0% · answered 67.1%

    Logic 46.4%

    Its run record (Method) →

    65.0%67.1%26.4%
  10. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 56.3% · answered 76.4%

    Logic 49.2%

    Its run record (Method) →

    56.3%76.4%24.0%
  11. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Non-hallucination with “I don't know” 52.5% · answered 79.5%

    Logic 52.4%

    Its run record (Method) →

    52.5%79.5%23.3%
  12. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 43.5% · answered 84.4%

    Logic 54.8%

    Its run record (Method) →

    43.5%84.4%24.0%
  13. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 40.6% · answered 85.8%

    Logic 54.5%

    Its run record (Method) →

    40.6%85.8%24.2%
  14. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 35.8% · answered 87.8%

    Logic 55.2%

    Its run record (Method) →

    35.8%87.8%24.8%
  15. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Non-hallucination with “I don't know” 24.6% · answered 88.6%

    Logic 47.8%

    Its run record (Method) →

    24.6%88.6%39.4%
  16. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 21.6% · answered 93.5%

    Logic 58.4%

    Its run record (Method) →

    21.6%93.5%25.1%
  17. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Non-hallucination with “I don't know” 20.8% · answered 84.9%

    Logic 29.2%

    Its run record (Method) →

    20.8%84.9%67.4%
  18. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Non-hallucination with “I don't know” 20.7% · answered 90.8%

    Logic 41.9%

    Its run record (Method) →

    20.7%90.8%38.9%
  19. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Non-hallucination with “I don't know” 17.3% · answered 88.6%

    Logic 32.3%

    Its run record (Method) →

    17.3%88.6%61.4%
  20. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Non-hallucination with “I don't know” 17.2% · answered 85.8%

    Logic 23.6%

    Its run record (Method) →

    17.2%85.8%79.5%
  21. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 15.4% · answered 95.2%

    Logic 52.5%

    Its run record (Method) →

    15.4%95.2%27.6%
  22. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 13.4% · answered 93.6%

    Logic 45.9%

    Its run record (Method) →

    13.4%93.6%44.4%
  23. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 12.0% · answered 94.3%

    Logic 43.1%

    Its run record (Method) →

    12.0%94.3%44.3%
  24. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Non-hallucination with “I don't know” 11.3% · answered 91.8%

    Logic 24.7%

    Its run record (Method) →

    11.3%91.8%70.2%
  25. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 9.4% · answered 97.2%

    Logic 54.8%

    Its run record (Method) →

    9.4%97.2%27.4%
  26. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Non-hallucination with “I don't know” 9.2% · answered 94.9%

    Logic 39.7%

    Its run record (Method) →

    9.2%94.9%53.4%
  27. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 8.4% · answered 96.2%

    Logic 44.7%

    Its run record (Method) →

    8.4%96.2%43.0%
  28. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 7.7% · answered 97.2%

    Logic 48.2%

    Its run record (Method) →

    7.7%97.2%34.1%
  29. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Non-hallucination with “I don't know” 7.2% · answered 95.5%

    Logic 30.8%

    Its run record (Method) →

    7.2%95.5%61.6%
  30. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 7.0% · answered 97.8%

    Logic 53.3%

    Its run record (Method) →

    7.0%97.8%29.6%
  31. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 6.6% · answered 97.3%

    Logic 48.2%

    Its run record (Method) →

    6.6%97.3%39.6%
  32. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 6.4% · answered 96.8%

    Logic 39.7%

    Its run record (Method) →

    6.4%96.8%48.6%
  33. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 5.7% · answered 97.9%

    Logic 46.3%

    Its run record (Method) →

    5.7%97.9%35.3%
  34. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Non-hallucination with “I don't know” 5.3% · answered 98.4%

    Logic 54.6%

    Its run record (Method) →

    5.3%98.4%28.3%
  35. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 5.1% · answered 97.9%

    Logic 44.4%

    Its run record (Method) →

    5.1%97.9%40.8%
  36. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Non-hallucination with “I don't know” 5.0% · answered 97.7%

    Logic 42.6%

    Its run record (Method) →

    5.0%97.7%45.4%
  37. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Non-hallucination with “I don't know” 4.9% · answered 97.2%

    Logic 39.3%

    Its run record (Method) →

    4.9%97.2%55.2%
  38. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 4.8% · answered 99.1%

    Logic 60.7%

    Its run record (Method) →

    4.8%99.1%18.6%
  39. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Non-hallucination with “I don't know” 4.7% · answered 98.6%

    Logic 54.5%

    Its run record (Method) →

    4.7%98.6%29.2%
  40. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 4.5% · answered 98.7%

    Logic 53.1%

    Its run record (Method) →

    4.5%98.7%29.0%
  41. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 4.2% · answered 98.2%

    Logic 46.6%

    Its run record (Method) →

    4.2%98.2%41.7%
  42. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Non-hallucination with “I don't know” 3.9% · answered 98.8%

    Logic 50.0%

    Its run record (Method) →

    3.9%98.8%30.0%
  43. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 3.8% · answered 98.3%

    Logic 44.1%

    Its run record (Method) →

    3.8%98.3%42.5%
  44. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 3.4% · answered 98.3%

    Logic 40.4%

    Its run record (Method) →

    3.4%98.3%49.2%
  45. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 3.2% · answered 98.7%

    Logic 43.9%

    Its run record (Method) →

    3.2%98.7%39.6%
  46. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 3.2% · answered 98.5%

    Logic 45.1%

    Its run record (Method) →

    3.2%98.5%45.8%
  47. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Non-hallucination with “I don't know” 3.2% · answered 97.7%

    Logic 22.4%

    Its run record (Method) →

    3.2%97.7%72.3%
  48. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 3.1% · answered 98.8%

    Logic 46.4%

    Its run record (Method) →

    3.1%98.8%38.2%
  49. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 2.9% · answered 98.7%

    Logic 40.8%

    Its run record (Method) →

    2.9%98.7%45.6%
  50. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 2.6% · answered 98.8%

    Logic 44.4%

    Its run record (Method) →

    2.6%98.8%44.8%
  51. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Non-hallucination with “I don't know” 2.3% · answered 99.5%

    Logic 59.3%

    Its run record (Method) →

    2.3%99.5%21.6%
  52. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Non-hallucination with “I don't know” 2.2% · answered 98.6%

    Logic 32.1%

    Its run record (Method) →

    2.2%98.6%61.9%
  53. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 2.2% · answered 99.4%

    Logic 52.3%

    Its run record (Method) →

    2.2%99.4%29.2%
  54. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 2.1% · answered 99.5%

    Logic 57.9%

    Its run record (Method) →

    2.1%99.5%21.6%
  55. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Non-hallucination with “I don't know” 2.1% · answered 99.5%

    Logic 57.8%

    Its run record (Method) →

    2.1%99.5%24.4%
  56. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 2.0% · answered 99.0%

    Logic 38.9%

    Its run record (Method) →

    2.0%99.0%50.8%
  57. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 1.8% · answered 99.2%

    Logic 40.6%

    Its run record (Method) →

    1.8%99.2%45.9%
  58. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 1.7% · answered 99.6%

    Logic 58.7%

    Its run record (Method) →

    1.7%99.6%21.2%
  59. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Non-hallucination with “I don't know” 1.7% · answered 98.9%

    Logic 31.7%

    Its run record (Method) →

    1.7%98.9%65.2%
  60. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Non-hallucination with “I don't know” 1.7% · answered 99.3%

    Logic 45.3%

    Its run record (Method) →

    1.7%99.3%41.2%
  61. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 1.6% · answered 99.3%

    Logic 42.3%

    Its run record (Method) →

    1.6%99.3%44.6%
  62. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 1.6% · answered 99.2%

    Logic 40.8%

    Its run record (Method) →

    1.6%99.2%48.1%
  63. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 1.2% · answered 99.5%

    Logic 43.3%

    Its run record (Method) →

    1.2%99.5%42.5%
  64. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Non-hallucination with “I don't know” 1.1% · answered 99.6%

    Logic 50.6%

    Its run record (Method) →

    1.1%99.6%33.6%
  65. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 1.1% · answered 99.8%

    Logic 59.0%

    Its run record (Method) →

    1.1%99.8%21.6%
  66. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 0.9% · answered 99.6%

    Logic 44.3%

    Its run record (Method) →

    0.9%99.6%39.6%
  67. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Non-hallucination with “I don't know” 0.6% · answered 99.5%

    Logic 27.0%

    Its run record (Method) →

    0.6%99.5%72.0%
  68. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Non-hallucination with “I don't know” 0.3% · answered 99.8%

    Logic 26.7%

    Its run record (Method) →

    0.3%99.8%71.6%
  69. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Non-hallucination with “I don't know” 0.2% · answered 100.0%

    Logic 58.9%

    Its run record (Method) →

    0.2%100.0%19.8%

Liquid AI Celeris Fastino Base Labs Subquadratic Nace.AI Other Perplexity StartLux EldanRing TypeSafe tattrongvu victorbennett vLLM Semantic Router Microsoft Zefan Cai Blockbrain Labs MachinePulse Google scar-ai quincyqiang PelaAI Inception Strands Agents newsbang Valen-Team REAX Metask Lab Turion.AI Sthānika AI Logits Cloudflare OmniJev Poindexter Labs Patrick-18 Apertix AI A setup that always chose F would reach 100% with no right answers.

Saying “I don't know”, or held back by confidence

Each setup's non-hallucination rate with F, and its five-option run held back by its own confidence at about the same attempt rate (it answers only where the chosen option's probability reaches the cut-off that keeps that share; tb-next's derived rate) · higher is better

  1. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Non-hallucination with “I don't know” 87.4% · answered 61.2%

    Logic 54.9%

    Its run record (Method) →

    87.4%90.6%
  2. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 86.7% · answered 58.4%

    Logic 51.6%

    Its run record (Method) →

    86.7%88.8%
  3. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.9% · answered 62.1%

    Logic 47.3%

    Its run record (Method) →

    82.9%84.6%
  4. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.7% · answered 61.8%

    Logic 47.3%

    Its run record (Method) →

    82.7%84.7%
  5. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 82.5% · answered 55.9%

    Logic 46.0%

    Its run record (Method) →

    82.5%84.5%
  6. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Non-hallucination with “I don't know” 80.2% · answered 33.7%

    Logic 30.7%

    Its run record (Method) →

    80.2%80.8%
  7. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Non-hallucination with “I don't know” 72.8% · answered 32.5%

    Logic 23.2%

    Its run record (Method) →

    72.8%72.2%
  8. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 70.6% · answered 75.5%

    Logic 54.5%

    Its run record (Method) →

    70.6%71.7%
  9. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 65.0% · answered 67.1%

    Logic 46.4%

    Its run record (Method) →

    65.0%66.3%
  10. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 56.3% · answered 76.4%

    Logic 49.2%

    Its run record (Method) →

    56.3%56.3%
  11. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Non-hallucination with “I don't know” 52.5% · answered 79.5%

    Logic 52.4%

    Its run record (Method) →

    52.5%53.3%
  12. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 43.5% · answered 84.4%

    Logic 54.8%

    Its run record (Method) →

    43.5%45.4%
  13. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 40.6% · answered 85.8%

    Logic 54.5%

    Its run record (Method) →

    40.6%42.2%
  14. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 35.8% · answered 87.8%

    Logic 55.2%

    Its run record (Method) →

    35.8%35.8%
  15. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Non-hallucination with “I don't know” 24.6% · answered 88.6%

    Logic 47.8%

    Its run record (Method) →

    24.6%25.3%
  16. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 21.6% · answered 93.5%

    Logic 58.4%

    Its run record (Method) →

    21.6%21.7%
  17. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Non-hallucination with “I don't know” 20.8% · answered 84.9%

    Logic 29.2%

    Its run record (Method) →

    20.8%21.0%
  18. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Non-hallucination with “I don't know” 20.7% · answered 90.8%

    Logic 41.9%

    Its run record (Method) →

    20.7%21.3%
  19. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Non-hallucination with “I don't know” 17.3% · answered 88.6%

    Logic 32.3%

    Its run record (Method) →

    17.3%17.2%
  20. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Non-hallucination with “I don't know” 17.2% · answered 85.8%

    Logic 23.6%

    Its run record (Method) →

    17.2%17.6%
  21. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 15.4% · answered 95.2%

    Logic 52.5%

    Its run record (Method) →

    15.4%15.0%
  22. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 13.4% · answered 93.6%

    Logic 45.9%

    Its run record (Method) →

    13.4%14.0%
  23. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 12.0% · answered 94.3%

    Logic 43.1%

    Its run record (Method) →

    12.0%12.3%
  24. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Non-hallucination with “I don't know” 11.3% · answered 91.8%

    Logic 24.7%

    Its run record (Method) →

    11.3%11.4%
  25. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 9.4% · answered 97.2%

    Logic 54.8%

    Its run record (Method) →

    9.4%9.8%
  26. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Non-hallucination with “I don't know” 9.2% · answered 94.9%

    Logic 39.7%

    Its run record (Method) →

    9.2%9.5%
  27. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 8.4% · answered 96.2%

    Logic 44.7%

    Its run record (Method) →

    8.4%8.4%
  28. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 7.7% · answered 97.2%

    Logic 48.2%

    Its run record (Method) →

    7.7%7.1%
  29. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Non-hallucination with “I don't know” 7.2% · answered 95.5%

    Logic 30.8%

    Its run record (Method) →

    7.2%7.2%
  30. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 7.0% · answered 97.8%

    Logic 53.3%

    Its run record (Method) →

    7.0%7.1%
  31. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 6.6% · answered 97.3%

    Logic 48.2%

    Its run record (Method) →

    6.6%6.7%
  32. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 6.4% · answered 96.8%

    Logic 39.7%

    Its run record (Method) →

    6.4%6.6%
  33. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 5.7% · answered 97.9%

    Logic 46.3%

    Its run record (Method) →

    5.7%5.0%
  34. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Non-hallucination with “I don't know” 5.3% · answered 98.4%

    Logic 54.6%

    Its run record (Method) →

    5.3%5.4%
  35. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 5.1% · answered 97.9%

    Logic 44.4%

    Its run record (Method) →

    5.1%5.2%
  36. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Non-hallucination with “I don't know” 5.0% · answered 97.7%

    Logic 42.6%

    Its run record (Method) →

    5.0%5.0%
  37. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Non-hallucination with “I don't know” 4.9% · answered 97.2%

    Logic 39.3%

    Its run record (Method) →

    4.9%4.9%
  38. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 4.8% · answered 99.1%

    Logic 60.7%

    Its run record (Method) →

    4.8%5.0%
  39. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Non-hallucination with “I don't know” 4.7% · answered 98.6%

    Logic 54.5%

    Its run record (Method) →

    4.7%4.8%
  40. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 4.5% · answered 98.7%

    Logic 53.1%

    Its run record (Method) →

    4.5%4.5%
  41. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 4.2% · answered 98.2%

    Logic 46.6%

    Its run record (Method) →

    4.2%4.3%
  42. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Non-hallucination with “I don't know” 3.9% · answered 98.8%

    Logic 50.0%

    Its run record (Method) →

    3.9%4.2%
  43. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 3.8% · answered 98.3%

    Logic 44.1%

    Its run record (Method) →

    3.8%3.8%
  44. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Non-hallucination with “I don't know” 3.4% · answered 98.3%

    Logic 40.4%

    Its run record (Method) →

    3.4%3.4%
  45. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 3.2% · answered 98.7%

    Logic 43.9%

    Its run record (Method) →

    3.2%3.2%
  46. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 3.2% · answered 98.5%

    Logic 45.1%

    Its run record (Method) →

    3.2%3.2%
  47. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Non-hallucination with “I don't know” 3.2% · answered 97.7%

    Logic 22.4%

    Its run record (Method) →

    3.2%3.2%
  48. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 3.1% · answered 98.8%

    Logic 46.4%

    Its run record (Method) →

    3.1%3.1%
  49. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Non-hallucination with “I don't know” 2.9% · answered 98.7%

    Logic 40.8%

    Its run record (Method) →

    2.9%3.0%
  50. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 2.6% · answered 98.8%

    Logic 44.4%

    Its run record (Method) →

    2.6%2.7%
  51. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Non-hallucination with “I don't know” 2.3% · answered 99.5%

    Logic 59.3%

    Its run record (Method) →

    2.3%2.3%
  52. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Non-hallucination with “I don't know” 2.2% · answered 98.6%

    Logic 32.1%

    Its run record (Method) →

    2.2%2.2%
  53. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 2.2% · answered 99.4%

    Logic 52.3%

    Its run record (Method) →

    2.2%2.1%
  54. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 2.1% · answered 99.5%

    Logic 57.9%

    Its run record (Method) →

    2.1%2.0%
  55. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Non-hallucination with “I don't know” 2.1% · answered 99.5%

    Logic 57.8%

    Its run record (Method) →

    2.1%2.0%
  56. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 2.0% · answered 99.0%

    Logic 38.9%

    Its run record (Method) →

    2.0%2.0%
  57. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 1.8% · answered 99.2%

    Logic 40.6%

    Its run record (Method) →

    1.8%1.8%
  58. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 1.7% · answered 99.6%

    Logic 58.7%

    Its run record (Method) →

    1.7%1.6%
  59. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Non-hallucination with “I don't know” 1.7% · answered 98.9%

    Logic 31.7%

    Its run record (Method) →

    1.7%1.7%
  60. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Non-hallucination with “I don't know” 1.7% · answered 99.3%

    Logic 45.3%

    Its run record (Method) →

    1.7%1.7%
  61. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Non-hallucination with “I don't know” 1.6% · answered 99.3%

    Logic 42.3%

    Its run record (Method) →

    1.6%1.7%
  62. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Non-hallucination with “I don't know” 1.6% · answered 99.2%

    Logic 40.8%

    Its run record (Method) →

    1.6%1.6%
  63. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Non-hallucination with “I don't know” 1.2% · answered 99.5%

    Logic 43.3%

    Its run record (Method) →

    1.2%1.2%
  64. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Non-hallucination with “I don't know” 1.1% · answered 99.6%

    Logic 50.6%

    Its run record (Method) →

    1.1%1.1%
  65. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Non-hallucination with “I don't know” 1.1% · answered 99.8%

    Logic 59.0%

    Its run record (Method) →

    1.1%1.0%
  66. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Non-hallucination with “I don't know” 0.9% · answered 99.6%

    Logic 44.3%

    Its run record (Method) →

    0.9%0.9%
  67. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Non-hallucination with “I don't know” 0.6% · answered 99.5%

    Logic 27.0%

    Its run record (Method) →

    0.6%0.6%
  68. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Non-hallucination with “I don't know” 0.3% · answered 99.8%

    Logic 26.7%

    Its run record (Method) →

    0.3%0.3%
  69. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Non-hallucination with “I don't know” 0.2% · answered 100.0%

    Logic 58.9%

    Its run record (Method) →

    0.2%0.2%

Liquid AI Celeris Fastino Base Labs Subquadratic Nace.AI Other Perplexity StartLux EldanRing TypeSafe tattrongvu victorbennett vLLM Semantic Router Microsoft Zefan Cai Blockbrain Labs MachinePulse Google scar-ai quincyqiang PelaAI Inception Strands Agents newsbang Valen-Team REAX Metask Lab Turion.AI Sthānika AI Logits Cloudflare OmniJev Poindexter Labs Patrick-18 Apertix AI Solid: with F Striped: held back by its own confidence

Counts with F on offer

SetupWebNquestions answeredRightWronga letter A–E, or noneI don't knowoption FNon-hallucinationof answers not right, % “I don't know” · higher is better · F / (F + wrong)Answerednot “I don't know”: (right + wrong) / NError rateof its answers: wrong / (right + wrong) · lower is betterAccuracy when answeringright / (right + wrong)Held back by confidencenon-hallucination at the same attempt rate
d1-ultra Closed · Efficient—2,1631,20212184087.4%61.2%9.1%90.9%90.6%
d1.2-ultra Closed · Undisclosed—2,1631,12613889986.7%58.4%10.9%89.1%88.8%
celeris-1.1-decision Closed · Efficient—2,1631,17416982082.9%62.1%12.6%87.4%84.6%
celeris-1-decision Closed · Efficient—2,1631,16417382682.7%61.8%12.9%87.1%84.7%
d1.1 Closed · Efficient—2,1631,00720295482.5%55.9%16.7%83.3%84.5%
d1-2B Open · 1.9B—2,1633753541,43480.2%33.7%48.6%51.4%80.8%
GLiDE 0.4B Open · 0.4B—2,1631575461,46072.8%32.5%77.7%22.3%72.2%
Mammoth-1 Open · 27B—2,1631,41222153070.6%75.5%13.5%86.5%71.7%
Elephant-1 Open · 9.0B—2,1631,06938371165.0%67.1%26.4%73.6%66.3%
d1.2 Closed · Undisclosed—2,1631,25539751156.3%76.4%24.0%76.0%56.3%
SubQ Snap 1.1 Closed · Efficient—2,1631,31940144352.5%79.5%23.3%76.7%53.3%
Drex Max v1.1 Closed · Efficient (provisional)—2,1631,38843833743.5%84.4%24.0%76.0%45.4%
GLiDE API Closed · Efficient—2,1631,40645030740.6%85.8%24.2%75.8%42.2%
GLiDE v1.2 Open · 27B—2,1631,42847226335.8%87.8%24.8%75.2%35.8%
GLiDE 9B Open · 7.9B—2,1631,16275524624.6%88.6%39.4%60.6%25.3%
GLiDE 27B Open · 27B—2,1631,51650714021.6%93.5%25.1%74.9%21.7%
GLiDE 0.8B Open · 0.8B—2,1635981,23932620.8%84.9%67.4%32.6%21.0%
Drex 2.0 Open · 35B MoE · 3.0B active—2,1631,19976420020.7%90.8%38.9%61.1%21.3%
GLiDE 2B Open · 1.9B—2,1637401,17724617.3%88.6%61.4%38.6%17.2%
GLiClass v4 Edge Open · 0.4B—2,1633801,47630717.2%85.8%79.5%20.5%17.6%
Perplexity Decider 27B v1.2 API · with web Open · 27Bwith web2,1631,49256810315.4%95.2%27.6%72.4%15.0%
StartLux-Decision-v1.1-4B-Instant Open · 4.0B—2,1631,12589913913.4%93.6%44.4%55.6%14.0%
Perplexity Decider Flash v1.2 Open · 4.0B—2,1631,13690412312.0%94.3%44.3%55.7%12.3%
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B—2,1635921,39417711.3%91.8%70.2%29.8%11.4%
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B—2,1631,527576609.4%97.2%27.4%72.6%9.8%
Winnow-12B Open · 12B—2,1639561,0961119.2%94.9%53.4%46.6%9.5%
Perplexity Decider Flash v1.3 Open · 4.0B—2,1631,187894828.4%96.2%43.0%57.0%8.4%
Jev 1.14 Closed · Efficient—2,1631,386717607.7%97.2%34.1%65.9%7.1%
StartLux-Decision-v1.1-2B-Instant Open · 2.0B—2,1637931,272987.2%95.5%61.6%38.4%7.2%
Perplexity Decider 27B v1.2 API Open · 27B—2,1631,490626477.0%97.8%29.6%70.4%7.1%
Jeffan-9B-1211 Open · 9.0B—2,1631,271833596.6%97.3%39.6%60.4%6.7%
Verdin-4B-v1.1 Open · 4.0B—2,1631,0751,018706.4%96.8%48.6%51.4%6.6%
Jev 1.13 Closed · Efficient—2,1631,370748455.7%97.9%35.3%64.7%5.0%
d3-ultra Open · 26B—2,1631,527602345.3%98.4%28.3%71.7%5.4%
Microsoft-Decision-1 Closed · Efficient—2,1631,254863465.1%97.9%40.8%59.2%5.2%
Open-Jev-27B-v1.1 Open · 27B—2,1631,154959505.0%97.7%45.4%54.6%5.0%
Cygnet Open · 12B—2,1639421,161604.9%97.2%55.2%44.8%4.9%
Karpo Decision 31B Open · 31B—2,1631,745398204.8%99.1%18.6%81.4%5.0%
d3 Open · 26B—2,1631,509623314.7%98.6%29.2%70.8%4.8%
Drex Max Open · 27B—2,1631,515619294.5%98.7%29.0%71.0%4.5%
StartLux-Decision-v1.1-9B-Instant Open · 9.0B—2,1631,239885394.2%98.2%41.7%58.3%4.3%
Gemini Decision 1 20261111 Closed · Efficient—2,1631,496641263.9%98.8%30.0%70.0%4.2%
vera-medium-omni Open · 4.2B—2,1631,222905363.8%98.3%42.5%57.5%3.8%
Chinese Decision Pointer 4B Open · 4.0B—2,1631,0811,045373.4%98.3%49.2%50.8%3.4%
KnowLine-9B-Gen2 Open · 9.0B—2,1631,289846283.2%98.7%39.6%60.4%3.2%
Mercury Decide Closed · Efficient—2,1631,156975323.2%98.5%45.8%54.2%3.2%
Strands Decider 2B Open · 2.0B—2,1635861,527503.2%97.7%72.3%27.7%3.2%
Adjudex 9B v5 Open · 9.0B—2,1631,321816263.1%98.8%38.2%61.8%3.1%
d1 Closed · Efficient—2,1631,161973292.9%98.7%45.6%54.4%3.0%
Valen-Decision-1.5-9B Open · 9.0B—2,1631,179958262.6%98.8%44.8%55.2%2.7%
REAX 1.3 Open · 57B—2,1631,688464112.3%99.5%21.6%78.4%2.3%
Metask-Jev-4B Open · 4.5B—2,1638131,320302.2%98.6%61.9%38.1%2.2%
Turion Jev 31B Open · 31B—2,1631,521628142.2%99.4%29.2%70.8%2.1%
Sieve 31B v3 Open · 31B—2,1631,688465102.1%99.5%21.6%78.4%2.0%
Logits Sigma-1 Duo Open · 57B—2,1631,627525112.1%99.5%24.4%75.6%2.0%
Clef-Flash Open · 9.0B—2,1631,0531,088222.0%99.0%50.8%49.2%2.0%
OneJev-27B Open · 27B—2,1631,160985181.8%99.2%45.9%54.1%1.8%
Copernicus-31B Open · 31B—2,1631,69845781.7%99.6%21.2%78.8%1.6%
KnowLine-2B-Gen1 Open · 2.0B—2,1637441,395241.7%98.9%65.2%34.8%1.7%
Dexy-Decision-9B-V2 Open · 9.0B—2,1631,263885151.7%99.3%41.2%58.8%1.7%
KnowLine 4B Gen5.5 Open · 4.0B—2,1631,190957161.6%99.3%44.6%55.4%1.7%
Clef Open · 27B—2,1631,1141,032171.6%99.2%48.1%51.9%1.6%
Cerno 9B v1.2 Open · 9.0B—2,1631,237915111.2%99.5%42.5%57.5%1.2%
KnowLine-12B-Gen1 Open · 12B—2,1631,43172481.1%99.6%33.6%66.4%1.1%
KnowLine-31B-Gen1.5 Open · 31B—2,1631,69246651.1%99.8%21.6%78.4%1.0%
KnowLine-9B-Gen1 Open · 9.0B—2,1631,30185480.9%99.6%39.6%60.4%0.9%
OneJev1.6-0.8B Open · 0.8B—2,1636031,550100.6%99.5%72.0%28.0%0.6%
KnowLine-0.8B-Gen1 Open · 0.8B—2,1636121,54650.3%99.8%71.6%28.4%0.3%
KnowLine-31B-Gen2 Open · 31B—2,1631,73342910.2%100.0%19.8%80.2%0.2%

SubQ Snap Preview and SubQ Snap 1.1 returned the same answer to every question (and the same probabilities on 2,151 of 2,163); shown once.

Perplexity Decider 27B v1.2 (API) and Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell): two setups of the same model, one on an NVIDIA RTX PRO 6000 Blackwell (96 GB) and one through Perplexity's API; not verified to be identical weights or settings. Its row is the API setup on every test; Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell) is under the row's other settings and All setups.

Every setup, every measure

SetupWebAccuracy% of N (N ≤ 2,163) · Wilson 95%Tie groupHolm · McNemarRight / NquestionsKept at ≥99%right / wrongAUROCright vs wrongNon-hallucinationof answers not right, % “I don't know” · higher is betterMedian latencymsp90ms, nearest rankCost$ per 1,000 qper 1M q
Karpo Decision 31B Open · 31B

Karpo Decision 31B · MachinePulse · decision model

Parameters: 31B dense

Non-hallucination with “I don't know” 4.8% · answered 99.1%

Logic 60.7%

Its run record (Method) →

—81.6%79.9%–83.1%a1,764 / 2,163837 right of 837 kept0 mistakes · 1,326 skipped0.9034.8%answered 99%155 ms186 ms$0.113$113estimate · RTX PRO 6000 Blackwell
KnowLine-31B-Gen2 Open · 31B

KnowLine-31B-Gen2 · PelaAI · decision model

Parameters: 31B dense

Base model: Gemma 4 31B

Non-hallucination with “I don't know” 0.2% · answered 100.0%

Logic 58.9%

Its run record (Method) →

—80.3%78.5%–81.9%ab1,736 / 2,163469 right of 470 kept1 wrong · 1,693 skipped0.8980.2%answered 100%114 ms120 ms$0.083$83.14estimate · RTX PRO 6000 Blackwell
REAX 1.3 Open · 57B

REAX 1.3 · REAX · decision model

Parameters: 57.36B dense

Non-hallucination with “I don't know” 2.3% · answered 99.5%

Logic 59.3%

Its run record (Method) →

—78.0%76.2%–79.7%bc1,687 / 2,163178 right of 178 kept0 mistakes · 1,985 skipped0.9032.3%answered 99%189 ms232 ms$0.142$142estimate · RTX PRO 6000 Blackwell
KnowLine-31B-Gen1.5 Open · 31B

KnowLine-31B-Gen1.5 · PelaAI · decision model

Parameters: 31B dense

Non-hallucination with “I don't know” 1.1% · answered 99.8%

Logic 59.0%

Its run record (Method) →

—77.4%75.6%–79.1%cd1,674 / 2,163464 right of 465 kept1 wrong · 1,698 skipped0.8951.1%answered 100%764 ms867 ms$0.047$46.87estimate · DGX Spark
Copernicus-31B Open · 31B

Copernicus-31B · Poindexter Labs · decision model

Parameters: 31B dense

Non-hallucination with “I don't know” 1.7% · answered 99.6%

Logic 58.7%

Its run record (Method) →

—77.3%75.5%–79.1%cd1,673 / 2,163318 right of 318 kept0 mistakes · 1,845 skipped0.8991.7%answered 100%118 ms142 ms$0.084$84.42estimate · RTX PRO 6000 Blackwell
Sieve 31B v3 Open · 31B

Sieve 31B v3 · Sthānika AI · decision model

Parameters: 31B dense

Non-hallucination with “I don't know” 2.1% · answered 99.5%

Logic 57.9%

Its run record (Method) →

—77.1%75.3%–78.8%cd1,668 / 2,163215 right of 215 kept0 mistakes · 1,948 skipped0.8912.1%answered 100%637 ms735 ms$0.039$39.14estimate · DGX Spark
Logits Sigma-1 Duo Open · 57B

Logits Sigma-1 Duo · Logits · decision model

Parameters: 57.36B dense

Non-hallucination with “I don't know” 2.1% · answered 99.5%

Logic 57.8%

Its run record (Method) →

—75.2%73.4%–77.0%de1,627 / 2,16315 right of 15 kept0 mistakes · 2,148 skipped0.8992.1%answered 99%196 ms221 ms$0.141$141estimate · RTX PRO 6000 Blackwell
d1-ultra Closed · Efficient

d1-ultra · Liquid AI · decision model

Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

Non-hallucination with “I don't know” 87.4% · answered 61.2%

Logic 54.9%

Its run record (Method) →

—74.1%72.2%–75.9%defg1,603 / 2,163213 right of 213 kept0 mistakes · 1,950 skipped0.87687.4%answered 61%179 ms426 ms$0.006$6.14
Mammoth-1 Open · 27B

Mammoth-1 · Base Labs · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 70.6% · answered 75.5%

Logic 54.5%

Its run record (Method) →

—74.0%72.1%–75.8%defh1,600 / 2,163412 right of 412 kept0 mistakes · 1,751 skipped0.89570.6%answered 75%140 ms173 ms$0.023$22.56 list$0.104$104estimate · RTX PRO 6000 Blackwell
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B

Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 9.4% · answered 97.2%

Logic 54.8%

Its run record (Method) →

—72.5%70.6%–74.3%efghi1,568 / 2,163323 right of 323 kept0 mistakes · 1,840 skipped0.8569.4%answered 97%91 ms103 ms$0.066$65.87estimate · RTX PRO 6000 Blackwell
GLiDE 27B Open · 27B

GLiDE 27B · Fastino · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 21.6% · answered 93.5%

Logic 58.4%

Its run record (Method) →

—72.0%70.1%–73.8%efghij1,557 / 2,163198 right of 199 kept1 wrong · 1,964 skipped0.86421.6%answered 94%425 ms461 ms$0.026$26.16estimate · DGX Spark
d3-ultra Open · 26B

d3-ultra · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Non-hallucination with “I don't know” 5.3% · answered 98.4%

Logic 54.6%

Its run record (Method) →

—71.5%69.6%–73.4%fghij1,547 / 2,16311 right of 11 kept0 mistakes · 2,152 skipped0.8575.3%answered 98%118 ms148 ms$0.089$88.58estimate · RTX PRO 6000 Blackwell
Gemini Decision 1 20261111 Closed · Efficient

Gemini Decision 1 20261111 · Google · decision model

Parameters: not disclosed by maker (closed weights)

Non-hallucination with “I don't know” 3.9% · answered 98.8%

Logic 50.0%

Its run record (Method) →

—71.3%69.4%–73.2%efghij1,543 / 2,163214 right of 214 kept0 mistakes · 1,949 skipped0.8593.9%answered 99%226 ms351 ms$0.022$22.02
GLiDE API Closed · Efficient

GLiDE API · Fastino · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 40.6% · answered 85.8%

Logic 54.5%

Its run record (Method) →

—70.8%68.8%–72.7%fghij1,531 / 2,163161 right of 161 kept0 mistakes · 2,002 skipped0.86540.6%answered 86%264 ms279 ms$0.028$28.30
d3 Open · 26B

d3 · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Non-hallucination with “I don't know” 4.7% · answered 98.6%

Logic 54.5%

Its run record (Method) →

—70.4%68.5%–72.3%gij1,523 / 2,163162 right of 163 kept1 wrong · 2,000 skipped0.8784.7%answered 99%55 ms62 ms$0.041$40.61estimate · RTX PRO 6000 Blackwell
Drex Max Open · 27B

Drex Max · Nace.AI · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 4.5% · answered 98.7%

Logic 53.1%

Its run record (Method) →

—70.3%68.4%–72.2%gijk1,521 / 2,163719 right of 729 kept10 wrong · 1,434 skipped0.8614.5%answered 99%76 ms89 ms$0.013$13.06 list$0.055$54.68estimate · RTX PRO 6000 Blackwell
Drex Max v1.1 Closed · Efficient (provisional)

Drex Max v1.1 · Nace.AI · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 43.5% · answered 84.4%

Logic 54.8%

Its run record (Method) →

—70.1%68.1%–72.0%ijk1,516 / 2,163315 right of 315 kept0 mistakes · 1,848 skipped0.86743.5%answered 84%326 ms473 ms$0.013$12.88
celeris-1-decision Closed · Efficient

celeris-1-decision · Celeris · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 82.7% · answered 61.8%

Logic 47.3%

Its run record (Method) →

—70.0%68.0%–71.9%hijk1,514 / 2,163No answers at this threshold0.85882.7%answered 62%387 ms391 ms$0.009$9.10
GLiDE v1.2 Open · 27B

GLiDE v1.2 · Fastino · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 35.8% · answered 87.8%

Logic 55.2%

Its run record (Method) →

—69.9%67.9%–71.8%ijk1,511 / 2,163131 right of 131 kept0 mistakes · 2,032 skipped0.86235.8%answered 88%79 ms84 ms$0.008$7.55 list$0.058$57.88estimate · RTX PRO 6000 Blackwell
celeris-1.1-decision Closed · Efficient

celeris-1.1-decision · Celeris · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 82.9% · answered 62.1%

Logic 47.3%

Its run record (Method) →

—69.9%67.9%–71.8%ijkl1,511 / 2,163No answers at this threshold0.85982.9%answered 62%381 ms386 ms$0.001$0.91
d1.2-ultra Closed · Undisclosed

d1.2-ultra · Liquid AI · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 86.7% · answered 58.4%

Logic 51.6%

Its run record (Method) →

—69.9%67.9%–71.8%ijk1,511 / 2,163115 right of 115 kept0 mistakes · 2,048 skipped0.87686.7%answered 58%215 ms347 ms$0.006$6.14
Perplexity Decider 27B v1.2 API Open · 27B

Perplexity Decider 27B v1.2 API · Perplexity · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 7.0% · answered 97.8%

Logic 53.3%

Its run record (Method) →

—69.8%67.8%–71.7%ijkl1,509 / 2,163331 right of 331 kept0 mistakes · 1,832 skipped0.8697.0%answered 98%226 ms368 ms$0.004$4.29
Perplexity Decider 27B v1.2 API · with web Open · 27B

Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 15.4% · answered 95.2%

Logic 52.5%

Its run record (Method) →

with web69.3%67.3%–71.2%jklm1,499 / 2,163326 right of 326 kept0 mistakes · 1,837 skipped0.87315.4%answered 95%422 ms641 ms$1.023$1,023
Turion Jev 31B Open · 31B

Turion Jev 31B · Turion.AI · decision model

Parameters: 31B dense

Non-hallucination with “I don't know” 2.2% · answered 99.4%

Logic 52.3%

Its run record (Method) →

—69.0%67.0%–70.9%ijklmn1,493 / 2,16343 right of 43 kept0 mistakes · 2,120 skipped0.8642.2%answered 99%278 ms329 ms$0.017$17.46estimate · DGX Spark
SubQ Snap 1.1 Closed · Efficient

SubQ Snap 1.1 · Subquadratic · decision model

Parameters: not disclosed by maker

Shown once with SubQ Snap Preview: the same answer to every question

Non-hallucination with “I don't know” 52.5% · answered 79.5%

Logic 52.4%

Its run record (Method) →

—68.6%66.6%–70.5%jklmn1,483 / 2,163360 right of 361 kept1 wrong · 1,802 skipped0.83952.5%answered 80%381 ms390 ms$0.009$8.59
KnowLine-12B-Gen1 Open · 12B

KnowLine-12B-Gen1 · PelaAI · decision model

Parameters: 12B dense

Base model: Gemma 4 12B

Non-hallucination with “I don't know” 1.1% · answered 99.6%

Logic 50.6%

Its run record (Method) →

—66.3%64.2%–68.2%klmno1,433 / 2,1637 right of 7 kept0 mistakes · 2,156 skipped0.8191.1%answered 100%49 ms55 ms$0.036$36.13estimate · RTX PRO 6000 Blackwell
d1.2 Closed · Undisclosed

d1.2 · Liquid AI · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 56.3% · answered 76.4%

Logic 49.2%

Its run record (Method) →

—65.5%63.5%–67.5%lmnop1,417 / 2,163141 right of 141 kept0 mistakes · 2,022 skipped0.83856.3%answered 76%204 ms386 ms$0.003$2.92
d1.1 Closed · Efficient

d1.1 · Liquid AI · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 82.5% · answered 55.9%

Logic 46.0%

Its run record (Method) →

—65.2%63.2%–67.2%mnop1,410 / 2,163183 right of 183 kept0 mistakes · 1,980 skipped0.82982.5%answered 56%172 ms290 ms$0.003$2.92
Jev 1.14 Closed · Efficient

Jev 1.14 · TypeSafe · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 7.7% · answered 97.2%

Logic 48.2%

Its run record (Method) →

—65.1%63.1%–67.1%nop1,409 / 2,163202 right of 202 kept0 mistakes · 1,961 skipped0.8297.7%answered 97%163 ms185 ms$0.019$18.99
Jev 1.13 Closed · Efficient

Jev 1.13 · TypeSafe · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 5.7% · answered 97.9%

Logic 46.3%

Its run record (Method) →

—64.1%62.0%–66.1%opq1,386 / 2,163248 right of 248 kept0 mistakes · 1,915 skipped0.8345.7%answered 98%166 ms206 ms$0.019$18.99
Adjudex 9B v5 Open · 9.0B

Adjudex 9B v5 · newsbang · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 3.1% · answered 98.8%

Logic 46.4%

Its run record (Method) →

—62.1%60.0%–64.1%opqr1,343 / 2,163197 right of 198 kept1 wrong · 1,965 skipped0.8063.1%answered 99%36 ms44 ms$0.027$26.54estimate · RTX PRO 6000 Blackwell
Elephant-1 Open · 9.0B

Elephant-1 · Base Labs · decision model

Parameters: 9B dense

Non-hallucination with “I don't know” 65.0% · answered 67.1%

Logic 46.4%

Its run record (Method) →

—61.3%59.3%–63.4%pqr1,327 / 2,163182 right of 183 kept1 wrong · 1,980 skipped0.80365.0%answered 67%80 ms92 ms$0.008$7.90 list$0.058$58.20estimate · RTX PRO 6000 Blackwell
KnowLine-9B-Gen2 Open · 9.0B

KnowLine-9B-Gen2 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 3.2% · answered 98.7%

Logic 43.9%

Its run record (Method) →

—60.1%58.0%–62.1%qrs1,300 / 2,163No answers at this threshold0.8033.2%answered 99%41 ms46 ms$0.031$31.02estimate · RTX PRO 6000 Blackwell
Jeffan-9B-1211 Open · 9.0B

Jeffan-9B-1211 · tattrongvu · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 6.6% · answered 97.3%

Logic 48.2%

Its run record (Method) →

—59.8%57.7%–61.9%qrs1,294 / 2,16364 right of 64 kept0 mistakes · 2,099 skipped0.8146.6%answered 97%37 ms51 ms$0.029$28.78estimate · RTX PRO 6000 Blackwell
KnowLine-9B-Gen1 Open · 9.0B

KnowLine-9B-Gen1 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 0.9% · answered 99.6%

Logic 44.3%

Its run record (Method) →

—59.8%57.7%–61.8%qrs1,293 / 2,163123 right of 123 kept0 mistakes · 2,040 skipped0.7990.9%answered 100%37 ms43 ms$0.027$26.54estimate · RTX PRO 6000 Blackwell
Microsoft-Decision-1 Closed · Efficient

Microsoft-Decision-1 · Microsoft · decision model

Parameters: not disclosed by maker

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 5.1% · answered 97.9%

Logic 44.4%

Its run record (Method) →

—59.4%57.3%–61.4%rst1,284 / 2,16327 right of 27 kept0 mistakes · 2,136 skipped0.7875.1%answered 98%310 ms359 ms$0.007$6.81
Drex 2.0 Open · 35B MoE · 3.0B active

Drex 2.0 · Nace.AI · decision model

Parameters: 35B MoE · 3B active

Non-hallucination with “I don't know” 20.7% · answered 90.8%

Logic 41.9%

Its run record (Method) →

—59.0%56.9%–61.0%rstu1,276 / 2,163174 right of 174 kept0 mistakes · 1,989 skipped0.81320.7%answered 91%334 ms432 ms$0.009$8.92
Dexy-Decision-9B-V2 Open · 9.0B

Dexy-Decision-9B-V2 · Patrick-18 · decision model

Parameters: 9B dense

Base model: vllm-sr/d3-flash

Non-hallucination with “I don't know” 1.7% · answered 99.3%

Logic 45.3%

Its run record (Method) →

—58.8%56.7%–60.9%rstu1,272 / 2,163207 right of 210 kept3 wrong · 1,953 skipped0.8041.7%answered 99%45 ms50 ms$0.032$31.98estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-9B-Instant Open · 9.0B

StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

Parameters: 9B dense

Non-hallucination with “I don't know” 4.2% · answered 98.2%

Logic 46.6%

Its run record (Method) →

—58.4%56.3%–60.5%rstuv1,264 / 2,16349 right of 49 kept0 mistakes · 2,114 skipped0.7814.2%answered 98%140 ms146 ms$0.008$8.34estimate · DGX Spark
GLiDE 9B Open · 7.9B

GLiDE 9B · Fastino · decision model

Parameters: 7.94B dense

Non-hallucination with “I don't know” 24.6% · answered 88.6%

Logic 47.8%

Its run record (Method) →

—57.9%55.8%–60.0%rstuvw1,253 / 2,16373 right of 73 kept0 mistakes · 2,090 skipped0.79824.6%answered 89%174 ms182 ms$0.010$10.49estimate · DGX Spark
vera-medium-omni Open · 4.2B

vera-medium-omni · scar-ai · decision model

Parameters: 4.2B dense

Base model: Qwen3.5-4B

Non-hallucination with “I don't know” 3.8% · answered 98.3%

Logic 44.1%

Its run record (Method) →

—56.8%54.7%–58.9%stuvw1,229 / 2,16333 right of 33 kept0 mistakes · 2,130 skipped0.7893.8%answered 98%31 ms35 ms$0.023$23.34estimate · RTX PRO 6000 Blackwell
Cerno 9B v1.2 Open · 9.0B

Cerno 9B v1.2 · Apertix AI · decision model

Parameters: 9B dense

Non-hallucination with “I don't know” 1.2% · answered 99.5%

Logic 43.3%

Its run record (Method) →

—56.0%53.9%–58.1%stuvw1,212 / 2,163244 right of 254 kept10 wrong · 1,909 skipped0.7801.2%answered 99%153 ms175 ms$0.010$9.51estimate · DGX Spark
KnowLine 4B Gen5.5 Open · 4.0B

KnowLine 4B Gen5.5 · PelaAI · decision model

Parameters: 4B dense

Non-hallucination with “I don't know” 1.6% · answered 99.3%

Logic 42.3%

Its run record (Method) →

—56.0%53.9%–58.1%stuvw1,211 / 2,16354 right of 54 kept0 mistakes · 2,109 skipped0.7651.6%answered 99%74 ms84 ms$0.005$4.56estimate · DGX Spark
Perplexity Decider Flash v1.3 Open · 4.0B

Perplexity Decider Flash v1.3 · Perplexity · decision model

Parameters: 4B dense

Non-hallucination with “I don't know” 8.4% · answered 96.2%

Logic 44.7%

Its run record (Method) →

—55.9%53.8%–58.0%stuvw1,210 / 2,163113 right of 114 kept1 wrong · 2,049 skipped0.7878.4%answered 96%28 ms31 ms$0.022$22.38estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-4B-Instant Open · 4.0B

StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

Parameters: 4B dense

Non-hallucination with “I don't know” 13.4% · answered 93.6%

Logic 45.9%

Its run record (Method) →

—55.8%53.7%–57.9%stuvwx1,208 / 2,16396 right of 96 kept0 mistakes · 2,067 skipped0.77913.4%answered 94%67 ms69 ms$0.004$4.10estimate · DGX Spark
d1 Closed · Efficient

d1 · Liquid AI · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 2.9% · answered 98.7%

Logic 40.8%

Its run record (Method) →

—55.6%53.5%–57.7%stuvwxy1,203 / 2,163152 right of 152 kept0 mistakes · 2,011 skipped0.7672.9%answered 99%184 ms297 ms$0.003$2.92
Valen-Decision-1.5-9B Open · 9.0B

Valen-Decision-1.5-9B · Valen-Team · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Non-hallucination with “I don't know” 2.6% · answered 98.8%

Logic 44.4%

Its run record (Method) →

—55.3%53.2%–57.4%tuvwxy1,197 / 2,163130 right of 130 kept0 mistakes · 2,033 skipped0.7902.6%answered 99%58 ms64 ms$0.041$40.93estimate · RTX PRO 6000 Blackwell
Perplexity Decider Flash v1.2 Open · 4.0B

Perplexity Decider Flash v1.2 · Perplexity · decision model

Parameters: 4B dense

Non-hallucination with “I don't know” 12.0% · answered 94.3%

Logic 43.1%

Its run record (Method) →

—55.2%53.1%–57.3%tuvwxy1,195 / 2,163150 right of 155 kept5 wrong · 2,008 skipped0.78112.0%answered 94%40 ms47 ms$0.002$2.18 list$0.030$30.06estimate · RTX PRO 6000 Blackwell
Open-Jev-27B-v1.1 Open · 27B

Open-Jev-27B-v1.1 · Zefan Cai · decision model

Parameters: 27B dense

Base model: Qwen3.8-27B + adapter

Non-hallucination with “I don't know” 5.0% · answered 97.7%

Logic 42.6%

Its run record (Method) →

—54.6%52.4%–56.6%uvwxyz1,180 / 2,163No answers at this threshold0.7645.0%answered 98%233 ms272 ms$0.169$169estimate · RTX PRO 6000 Blackwell
OneJev-27B Open · 27B

OneJev-27B · OmniJev · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 1.8% · answered 99.2%

Logic 40.6%

Its run record (Method) →

—53.8%51.7%–55.9%vwxyzA1,163 / 2,16326 right of 26 kept0 mistakes · 2,137 skipped0.7831.8%answered 99%79 ms106 ms$0.061$60.76estimate · RTX PRO 6000 Blackwell
Mercury Decide Closed · Efficient

Mercury Decide · Inception · decision model

Parameters: not disclosed by maker

Non-hallucination with “I don't know” 3.2% · answered 98.5%

Logic 45.1%

Its run record (Method) →

—53.5%51.4%–55.6%wxyzA1,157 / 2,163272 right of 281 kept9 wrong · 1,882 skipped0.7893.2%answered 99%288 ms342 ms$0.004$4.38
Verdin-4B-v1.1 Open · 4.0B

Verdin-4B-v1.1 · victorbennett · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Non-hallucination with “I don't know” 6.4% · answered 96.8%

Logic 39.7%

Its run record (Method) →

—51.5%49.4%–53.6%yzAB1,114 / 2,163126 right of 130 kept4 wrong · 2,033 skipped0.7526.4%answered 97%47 ms52 ms$0.034$33.58estimate · RTX PRO 6000 Blackwell
Clef Open · 27B

Clef · Cloudflare · decision model

Parameters: 27B dense

Non-hallucination with “I don't know” 1.6% · answered 99.2%

Logic 40.8%

Its run record (Method) →

—51.1%49.0%–53.2%xyzAB1,105 / 2,16312 right of 12 kept0 mistakes · 2,151 skipped0.7671.6%answered 99%181 ms210 ms$0.069$68.54 list$0.131$131estimate · RTX PRO 6000 Blackwell
Chinese Decision Pointer 4B Open · 4.0B

Chinese Decision Pointer 4B · quincyqiang · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Non-hallucination with “I don't know” 3.4% · answered 98.3%

Logic 40.4%

Its run record (Method) →

—50.4%48.3%–52.5%zAB1,091 / 2,163149 right of 155 kept6 wrong · 2,008 skipped0.7463.4%answered 98%28 ms32 ms$0.023$22.70estimate · RTX PRO 6000 Blackwell
Clef-Flash Open · 9.0B

Clef-Flash · Cloudflare · decision model

Parameters: 9B dense

Non-hallucination with “I don't know” 2.0% · answered 99.0%

Logic 38.9%

Its run record (Method) →

—49.8%47.7%–51.9%AB1,077 / 2,163No answers at this threshold0.7302.0%answered 99%99 ms127 ms$0.011$10.85 list$0.072$71.95estimate · RTX PRO 6000 Blackwell
Winnow-12B Open · 12B

Winnow-12B · EldanRing · decision model

Parameters: 12B dense

Non-hallucination with “I don't know” 9.2% · answered 94.9%

Logic 39.7%

Its run record (Method) →

—46.9%44.8%–49.0%BC1,014 / 2,16320 right of 21 kept1 wrong · 2,142 skipped0.7439.2%answered 95%52 ms61 ms$0.038$38.37estimate · RTX PRO 6000 Blackwell
Cygnet Open · 12B

Cygnet · Blockbrain Labs · decision model

Parameters: 11.95B dense

Base model: Gemma 4 12B IT

Non-hallucination with “I don't know” 4.9% · answered 97.2%

Logic 39.3%

Its run record (Method) →

—44.3%42.3%–46.4%C959 / 2,163No answers at this threshold0.7354.9%answered 97%37 ms41 ms$0.024$23.94 list$0.028$27.50estimate · RTX PRO 6000 Blackwell
Metask-Jev-4B Open · 4.5B

Metask-Jev-4B · Metask Lab · decision model

Parameters: 4.54B dense

Non-hallucination with “I don't know” 2.2% · answered 98.6%

Logic 32.1%

Its run record (Method) →

—39.2%37.1%–41.2%D847 / 2,163No answers at this threshold0.6512.2%answered 99%113 ms144 ms$0.083$83.14estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-2B-Instant Open · 2.0B

StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

Parameters: 2B dense

Non-hallucination with “I don't know” 7.2% · answered 95.5%

Logic 30.8%

Its run record (Method) →

—38.7%36.6%–40.7%D836 / 2,1632 right of 2 kept0 mistakes · 2,161 skipped0.6857.2%answered 95%36 ms37 ms$0.002$2.27estimate · DGX Spark
d1-2B Open · 1.9B

d1-2B · Liquid AI · decision model

Parameters: 1.92B dense

Base model: LFM3-VL-2B

Non-hallucination with “I don't know” 80.2% · answered 33.7%

Logic 30.7%

Its run record (Method) →

—37.1%35.1%–39.1%D802 / 2,1634 right of 4 kept0 mistakes · 2,159 skipped0.65680.2%answered 34%16 ms21 ms$0.014$14.07estimate · RTX PRO 6000 Blackwell
GLiDE 2B Open · 1.9B

GLiDE 2B · Fastino · decision model

Parameters: 1.88B dense

Non-hallucination with “I don't know” 17.3% · answered 88.6%

Logic 32.3%

Its run record (Method) →

—36.8%34.7%–38.8%D795 / 2,16315 right of 16 kept1 wrong · 2,147 skipped0.63517.3%answered 89%28 ms30 ms$0.002$1.78estimate · DGX Spark
KnowLine-2B-Gen1 Open · 2.0B

KnowLine-2B-Gen1 · PelaAI · decision model

Parameters: 2B dense

Base model: Qwen3.5-2B

Non-hallucination with “I don't know” 1.7% · answered 98.9%

Logic 31.7%

Its run record (Method) →

—35.3%33.3%–37.3%DE763 / 2,1638 right of 8 kept0 mistakes · 2,155 skipped0.6361.7%answered 99%50 ms54 ms$0.003$3.20estimate · DGX Spark
GLiDE 0.8B Open · 0.8B

GLiDE 0.8B · Fastino · decision model

Parameters: 0.75B dense

Non-hallucination with “I don't know” 20.8% · answered 84.9%

Logic 29.2%

Its run record (Method) →

—32.1%30.2%–34.1%EF694 / 2,1634 right of 4 kept0 mistakes · 2,159 skipped0.58920.8%answered 85%20 ms21 ms$0.001$1.28estimate · DGX Spark
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B

StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Non-hallucination with “I don't know” 11.3% · answered 91.8%

Logic 24.7%

Its run record (Method) →

—29.7%27.8%–31.6%F642 / 2,163No answers at this threshold0.58311.3%answered 92%24 ms25 ms$0.002$1.53estimate · DGX Spark
Strands Decider 2B Open · 2.0B

Strands Decider 2B · Strands Agents · decision model

Parameters: 2B dense

Non-hallucination with “I don't know” 3.2% · answered 97.7%

Logic 22.4%

Its run record (Method) →

—28.7%26.8%–30.6%F620 / 2,163No answers at this threshold0.5693.2%answered 98%35 ms41 ms$0.026$26.22estimate · RTX PRO 6000 Blackwell
OneJev1.6-0.8B Open · 0.8B

OneJev1.6-0.8B · OmniJev · decision model

Parameters: 0.8B dense

Non-hallucination with “I don't know” 0.6% · answered 99.5%

Logic 27.0%

Its run record (Method) →

—28.2%26.4%–30.2%F611 / 2,163No answers at this threshold0.5920.6%answered 100%15 ms17 ms$0.001$1.09estimate · DGX Spark
KnowLine-0.8B-Gen1 Open · 0.8B

KnowLine-0.8B-Gen1 · PelaAI · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Non-hallucination with “I don't know” 0.3% · answered 99.8%

Logic 26.7%

Its run record (Method) →

—28.2%26.3%–30.1%F610 / 2,163No answers at this threshold0.5960.3%answered 100%25 ms28 ms$0.002$1.69estimate · DGX Spark
GLiClass v4 Edge Open · 0.4B

GLiClass v4 Edge · decision model

Parameters: 0.4B dense

Base model: DeBERTa-v3-large

Non-hallucination with “I don't know” 17.2% · answered 85.8%

Logic 23.6%

Its run record (Method) →

—22.7%20.9%–24.5%G490 / 2,163No answers at this threshold0.50117.2%answered 86%12 ms13 ms$0.001$0.85estimate · DGX Spark
GLiDE 0.4B Open · 0.4B

GLiDE 0.4B · Fastino · decision model

Parameters: 0.40B dense

Non-hallucination with “I don't know” 72.8% · answered 32.5%

Logic 23.2%

Its run record (Method) →

—20.6%18.9%–22.3%G445 / 2,163No answers at this threshold0.50072.8%answered 33%11 ms12 ms$0.001$0.77estimate · DGX Spark

Tie groups and “not measured”

estimate · RTX PRO 6000 Blackwell / DGX Spark = run on our own hardware; its cost is an estimate, explained on hover, focus or tap of the amount: the machine's wall-clock time on the run, first to last answer while it was running (pauses, estimated from gaps of more than 10 minutes between answers, left out and listed), × $2.49/h per NVIDIA RTX PRO 6000 Blackwell (96 GB) (Runpod's price for the card) or × $0.213/h per NVIDIA DGX Spark (GB10) (its purchase over three years plus electricity; see Method), each run charged in full even when runs shared the machine, so at most; sorting and the cost chart use the estimate; list = maker's list price × our token counts; unmarked = provider's price × usage the API reported.