Logic and Math · Non-hallucination

Non-hallucination on Logic and Math

Logic and Math pooled: 3,288 questions; only setups that finished both. How to read this page · Method

(a) Probabilistic confidence

Answers kept at the ≥99% confidence threshold

Share of the N questions whose chosen option had probability ≥99% in the five-option (standard) run: right (family colour) and wrong (red); beside it the counts right / wrong, whether any was wrong, and the AUROC of the chosen option's probability (right against wrong answers, 0.5 = no signal) · more kept with no mistake is better

  1. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 385 answers, 385 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 13.5% · answered 95.1%

    Logic 54.8% · Math 72.5%

    Its run record (Method) →

    385 / 0✓ 0 mistakes0.844
  2. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Kept at ≥99%: 384 answers, 384 right · 0 wrong · AUROC 0.873

    Non-hallucination with “I don't know” 1.8% · answered 99.5%

    Logic 58.7% · Math 77.3%

    Its run record (Method) →

    384 / 0✓ 0 mistakes0.873
  3. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 313 answers, 313 right · 0 wrong · AUROC 0.817

    Non-hallucination with “I don't know” 10.2% · answered 95.5%

    Logic 46.3% · Math 64.1%

    Its run record (Method) →

    313 / 0✓ 0 mistakes0.817
  4. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 263 answers, 263 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 15.4% · answered 93.3%

    Logic 48.2% · Math 65.1%

    Its run record (Method) →

    263 / 0✓ 0 mistakes0.810
  5. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Kept at ≥99%: 257 answers, 257 right · 0 wrong · AUROC 0.838

    Non-hallucination with “I don't know” 3.0% · answered 98.9%

    Logic 50.0% · Math 71.3%

    Its run record (Method) →

    257 / 0✓ 0 mistakes0.838
  6. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Kept at ≥99%: 233 answers, 233 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 89.1% · answered 52.3%

    Logic 54.9% · Math 74.1%

    Its run record (Method) →

    233 / 0✓ 0 mistakes0.852
  7. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 231 answers, 231 right · 0 wrong · AUROC 0.811

    Non-hallucination with “I don't know” 86.0% · answered 46.5%

    Logic 46.0% · Math 65.2%

    Its run record (Method) →

    231 / 0✓ 0 mistakes0.811
  8. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 229 answers, 229 right · 0 wrong · AUROC 0.878

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 59.3% · Math 78.0%

    Its run record (Method) →

    229 / 0✓ 0 mistakes0.878
  9. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 213 answers, 213 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 49.2% · answered 79.5%

    Logic 54.5% · Math 70.8%

    Its run record (Method) →

    213 / 0✓ 0 mistakes0.852
  10. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Kept at ≥99%: 207 answers, 207 right · 0 wrong · AUROC 0.789

    Non-hallucination with “I don't know” 28.1% · answered 85.3%

    Logic 41.9% · Math 59.0%

    Its run record (Method) →

    207 / 0✓ 0 mistakes0.789
  11. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 176 answers, 176 right · 0 wrong · AUROC 0.843

    Non-hallucination with “I don't know” 42.3% · answered 82.8%

    Logic 55.2% · Math 69.9%

    Its run record (Method) →

    176 / 0✓ 0 mistakes0.843
  12. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 169 answers, 169 right · 0 wrong · AUROC 0.812

    Non-hallucination with “I don't know” 66.9% · answered 65.1%

    Logic 49.2% · Math 65.5%

    Its run record (Method) →

    169 / 0✓ 0 mistakes0.812
  13. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 153 answers, 153 right · 0 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 3.4% · answered 98.4%

    Logic 44.3% · Math 59.8%

    Its run record (Method) →

    153 / 0✓ 0 mistakes0.782
  14. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 128 answers, 128 right · 0 wrong · AUROC 0.856

    Non-hallucination with “I don't know” 90.2% · answered 48.1%

    Logic 51.6% · Math 69.9%

    Its run record (Method) →

    128 / 0✓ 0 mistakes0.856
  15. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Kept at ≥99%: 117 answers, 117 right · 0 wrong · AUROC 0.763

    Non-hallucination with “I don't know” 14.4% · answered 92.6%

    Logic 45.9% · Math 55.8%

    Its run record (Method) →

    117 / 0✓ 0 mistakes0.763
  16. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Kept at ≥99%: 105 answers, 105 right · 0 wrong · AUROC 0.786

    Non-hallucination with “I don't know” 26.9% · answered 86.5%

    Logic 47.8% · Math 57.9%

    Its run record (Method) →

    105 / 0✓ 0 mistakes0.786
  17. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 74 answers, 74 right · 0 wrong · AUROC 0.798

    Non-hallucination with “I don't know” 13.5% · answered 93.7%

    Logic 48.2% · Math 59.8%

    Its run record (Method) →

    74 / 0✓ 0 mistakes0.798
  18. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Kept at ≥99%: 63 answers, 63 right · 0 wrong · AUROC 0.779

    Non-hallucination with “I don't know” 9.6% · answered 95.4%

    Logic 46.6% · Math 58.4%

    Its run record (Method) →

    63 / 0✓ 0 mistakes0.779
  19. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 50 answers, 50 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 1.9% · answered 99.3%

    Logic 52.3% · Math 69.0%

    Its run record (Method) →

    50 / 0✓ 0 mistakes0.844
  20. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Kept at ≥99%: 47 answers, 47 right · 0 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 11.4% · answered 94.5%

    Logic 44.4% · Math 59.4%

    Its run record (Method) →

    47 / 0✓ 0 mistakes0.769
  21. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.835

    Non-hallucination with “I don't know” 7.5% · answered 97.4%

    Logic 54.6% · Math 71.5%

    Its run record (Method) →

    39 / 0✓ 0 mistakes0.835
  22. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 7.9% · answered 96.1%

    Logic 44.1% · Math 56.8%

    Its run record (Method) →

    39 / 0✓ 0 mistakes0.777
  23. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Kept at ≥99%: 30 answers, 30 right · 0 wrong · AUROC 0.770

    Non-hallucination with “I don't know” 1.6% · answered 99.2%

    Logic 40.6% · Math 53.8%

    Its run record (Method) →

    30 / 0✓ 0 mistakes0.770
  24. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 23 answers, 23 right · 0 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 4.4% · answered 98.6%

    Logic 57.8% · Math 75.2%

    Its run record (Method) →

    23 / 0✓ 0 mistakes0.868
  25. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Kept at ≥99%: 18 answers, 18 right · 0 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 2.4% · answered 98.8%

    Logic 40.8% · Math 51.1%

    Its run record (Method) →

    18 / 0✓ 0 mistakes0.747
  26. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Kept at ≥99%: 16 answers, 16 right · 0 wrong · AUROC 0.626

    Non-hallucination with “I don't know” 6.8% · answered 95.3%

    Logic 31.7% · Math 35.3%

    Its run record (Method) →

    16 / 0✓ 0 mistakes0.626
  27. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.602

    Non-hallucination with “I don't know” 22.7% · answered 83.2%

    Logic 29.2% · Math 32.1%

    Its run record (Method) →

    13 / 0✓ 0 mistakes0.602
  28. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 4.5% · answered 98.2%

    Logic 50.6% · Math 66.3%

    Its run record (Method) →

    13 / 0✓ 0 mistakes0.810
  29. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Kept at ≥99%: 7 answers, 7 right · 0 wrong · AUROC 0.648

    Non-hallucination with “I don't know” 82.5% · answered 29.6%

    Logic 30.7% · Math 37.1%

    Its run record (Method) →

    7 / 0✓ 0 mistakes0.648
  30. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Kept at ≥99%: 4 answers, 4 right · 0 wrong · AUROC 0.675

    Non-hallucination with “I don't know” 16.4% · answered 88.9%

    Logic 30.8% · Math 38.7%

    Its run record (Method) →

    4 / 0✓ 0 mistakes0.675
  31. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.590

    Non-hallucination with “I don't know” 0.6% · answered 99.5%

    Logic 26.7% · Math 28.2%

    Its run record (Method) →

    2 / 0✓ 0 mistakes0.590
  32. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.576

    Non-hallucination with “I don't know” 2.0% · answered 98.5%

    Logic 27.0% · Math 28.2%

    Its run record (Method) →

    2 / 0✓ 0 mistakes0.576
  33. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.707

    Non-hallucination with “I don't know” 6.9% · answered 96.2%

    Logic 38.9% · Math 49.8%

    Its run record (Method) →

    No answers at this threshold–0.707
  34. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Kept at ≥99%: No answers at this threshold · AUROC 0.729

    Non-hallucination with “I don't know” 7.3% · answered 95.7%

    Logic 39.3% · Math 44.3%

    Its run record (Method) →

    No answers at this threshold–0.729
  35. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Kept at ≥99%: No answers at this threshold · AUROC 0.511

    Non-hallucination with “I don't know” 15.6% · answered 87.3%

    Logic 23.6% · Math 22.7%

    Its run record (Method) →

    No answers at this threshold–0.511
  36. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.520

    Non-hallucination with “I don't know” 73.9% · answered 31.7%

    Logic 23.2% · Math 20.6%

    Its run record (Method) →

    No answers at this threshold–0.520
  37. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: No answers at this threshold · AUROC 0.786

    Non-hallucination with “I don't know” 10.4% · answered 95.0%

    Logic 43.9% · Math 60.1%

    Its run record (Method) →

    No answers at this threshold–0.786
  38. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.659

    Non-hallucination with “I don't know” 2.0% · answered 98.7%

    Logic 32.1% · Math 39.2%

    Its run record (Method) →

    No answers at this threshold–0.659
  39. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Kept at ≥99%: No answers at this threshold · AUROC 0.759

    Non-hallucination with “I don't know” 14.5% · answered 92.4%

    Logic 42.6% · Math 54.6%

    Its run record (Method) →

    No answers at this threshold–0.759
  40. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: No answers at this threshold · AUROC 0.605

    Non-hallucination with “I don't know” 14.9% · answered 88.9%

    Logic 24.7% · Math 29.7%

    Its run record (Method) →

    No answers at this threshold–0.605
  41. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.573

    Non-hallucination with “I don't know” 5.0% · answered 96.3%

    Logic 22.4% · Math 28.7%

    Its run record (Method) →

    No answers at this threshold–0.573
  42. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.829

    Non-hallucination with “I don't know” 87.2% · answered 50.2%

    Logic 47.3% · Math 70.0%

    Its run record (Method) →

    No answers at this threshold–0.829
  43. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.830

    Non-hallucination with “I don't know” 86.7% · answered 50.8%

    Logic 47.3% · Math 69.9%

    Its run record (Method) →

    No answers at this threshold–0.830
  44. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Kept at ≥99%: 1,009 answers, 1,006 right · 3 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 5.7% · answered 98.5%

    Logic 60.7% · Math 81.6%

    Its run record (Method) →

    1,006 / 33 wrong0.882
  45. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Kept at ≥99%: 884 answers, 866 right · 18 wrong · AUROC 0.841

    Non-hallucination with “I don't know” 5.7% · answered 97.9%

    Logic 53.1% · Math 70.3%

    Its run record (Method) →

    866 / 1818 wrong0.841
  46. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 554 answers, 553 right · 1 wrong · AUROC 0.870

    Non-hallucination with “I don't know” 0.7% · answered 99.8%

    Logic 59.0% · Math 77.4%

    Its run record (Method) →

    553 / 11 wrong0.870
  47. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Kept at ≥99%: 524 answers, 523 right · 1 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 0.1% · answered 100.0%

    Logic 58.9% · Math 80.3%

    Its run record (Method) →

    523 / 11 wrong0.882
  48. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Kept at ≥99%: 520 answers, 518 right · 2 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 71.4% · answered 69.4%

    Logic 54.5% · Math 74.0%

    Its run record (Method) →

    518 / 22 wrong0.868
  49. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Kept at ≥99%: 433 answers, 430 right · 3 wrong · AUROC 0.827

    Non-hallucination with “I don't know” 58.3% · answered 73.2%

    Logic 52.4% · Math 68.6%

    Its run record (Method) →

    430 / 33 wrong0.827
  50. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 411 answers, 409 right · 2 wrong · AUROC 0.849

    Non-hallucination with “I don't know” 10.3% · answered 96.1%

    Logic 53.3% · Math 69.8%

    Its run record (Method) →

    409 / 22 wrong0.849
  51. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.846

    Non-hallucination with “I don't know” 48.3% · answered 79.2%

    Logic 54.8% · Math 70.1%

    Its run record (Method) →

    404 / 11 wrong0.846
  52. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.854

    Non-hallucination with “I don't know” 25.8% · answered 90.1%

    Logic 52.5% · Math 69.3%

    Its run record (Method) →

    404 / 11 wrong0.854
  53. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 372 answers, 356 right · 16 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 10.1% · answered 94.9%

    Logic 45.1% · Math 53.5%

    Its run record (Method) →

    356 / 1616 wrong0.777
  54. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 296 answers, 294 right · 2 wrong · AUROC 0.865

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 57.9% · Math 77.1%

    Its run record (Method) →

    294 / 22 wrong0.865
  55. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 274 answers, 272 right · 2 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 31.9% · answered 88.5%

    Logic 58.4% · Math 72.0%

    Its run record (Method) →

    272 / 22 wrong0.852
  56. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Kept at ≥99%: 281 answers, 270 right · 11 wrong · AUROC 0.776

    Non-hallucination with “I don't know” 3.1% · answered 98.5%

    Logic 43.3% · Math 56.0%

    Its run record (Method) →

    270 / 1111 wrong0.776
  57. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Kept at ≥99%: 266 answers, 263 right · 3 wrong · AUROC 0.795

    Non-hallucination with “I don't know” 6.1% · answered 97.1%

    Logic 45.3% · Math 58.8%

    Its run record (Method) →

    263 / 33 wrong0.795
  58. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 253 answers, 251 right · 2 wrong · AUROC 0.802

    Non-hallucination with “I don't know” 7.0% · answered 96.9%

    Logic 46.4% · Math 62.1%

    Its run record (Method) →

    251 / 22 wrong0.802
  59. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Kept at ≥99%: 236 answers, 235 right · 1 wrong · AUROC 0.797

    Non-hallucination with “I don't know” 69.4% · answered 60.3%

    Logic 46.4% · Math 61.3%

    Its run record (Method) →

    235 / 11 wrong0.797
  60. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 217 answers, 216 right · 1 wrong · AUROC 0.858

    Non-hallucination with “I don't know” 9.3% · answered 96.6%

    Logic 54.5% · Math 70.4%

    Its run record (Method) →

    216 / 11 wrong0.858
  61. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 208 answers, 207 right · 1 wrong · AUROC 0.757

    Non-hallucination with “I don't know” 6.4% · answered 96.7%

    Logic 40.8% · Math 55.6%

    Its run record (Method) →

    207 / 11 wrong0.757
  62. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 194 answers, 188 right · 6 wrong · AUROC 0.743

    Non-hallucination with “I don't know” 7.8% · answered 95.8%

    Logic 40.4% · Math 50.4%

    Its run record (Method) →

    188 / 66 wrong0.743
  63. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 190 answers, 185 right · 5 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 18.9% · answered 90.0%

    Logic 43.1% · Math 55.2%

    Its run record (Method) →

    185 / 55 wrong0.769
  64. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 167 answers, 165 right · 2 wrong · AUROC 0.765

    Non-hallucination with “I don't know” 7.1% · answered 96.4%

    Logic 44.4% · Math 55.3%

    Its run record (Method) →

    165 / 22 wrong0.765
  65. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 165 answers, 161 right · 4 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 8.9% · answered 95.2%

    Logic 39.7% · Math 51.5%

    Its run record (Method) →

    161 / 44 wrong0.747
  66. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 131 answers, 130 right · 1 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 15.0% · answered 92.4%

    Logic 44.7% · Math 55.9%

    Its run record (Method) →

    130 / 11 wrong0.782
  67. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Kept at ≥99%: 72 answers, 71 right · 1 wrong · AUROC 0.752

    Non-hallucination with “I don't know” 4.4% · answered 97.8%

    Logic 42.3% · Math 56.0%

    Its run record (Method) →

    71 / 11 wrong0.752
  68. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Kept at ≥99%: 53 answers, 52 right · 1 wrong · AUROC 0.737

    Non-hallucination with “I don't know” 17.1% · answered 89.8%

    Logic 39.7% · Math 46.9%

    Its run record (Method) →

    52 / 11 wrong0.737
  69. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Kept at ≥99%: 30 answers, 29 right · 1 wrong · AUROC 0.637

    Non-hallucination with “I don't know” 23.1% · answered 84.1%

    Logic 32.3% · Math 36.8%

    Its run record (Method) →

    29 / 11 wrong0.637

Perplexity Poindexter Labs TypeSafe Google Liquid AI REAX Fastino Nace.AI PelaAI StartLux tattrongvu Turion.AI Microsoft vLLM Semantic Router scar-ai OmniJev Logits Cloudflare Blockbrain Labs Other Metask Lab Zefan Cai Strands Agents Celeris MachinePulse Base Labs Subquadratic Inception Sthānika AI Apertix AI Patrick-18 newsbang quincyqiang Valen-Team victorbennett EldanRing Kept but wrong

(b) Explicit “I don't know” option

Non-hallucination with “I don't know”

F among the answers that were not right (F / (F + wrong)), with F offered as a sixth option; beside it the share answered (right + wrong of N) and the error rate among the answers (wrong / (right + wrong)) · higher non-hallucination is better, read with the share answered

  1. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 128 answers, 128 right · 0 wrong · AUROC 0.856

    Non-hallucination with “I don't know” 90.2% · answered 48.1%

    Logic 51.6% · Math 69.9%

    Its run record (Method) →

    90.2%48.1%11.7%
  2. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Kept at ≥99%: 233 answers, 233 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 89.1% · answered 52.3%

    Logic 54.9% · Math 74.1%

    Its run record (Method) →

    89.1%52.3%11.2%
  3. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.829

    Non-hallucination with “I don't know” 87.2% · answered 50.2%

    Logic 47.3% · Math 70.0%

    Its run record (Method) →

    87.2%50.2%14.6%
  4. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.830

    Non-hallucination with “I don't know” 86.7% · answered 50.8%

    Logic 47.3% · Math 69.9%

    Its run record (Method) →

    86.7%50.8%14.9%
  5. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 231 answers, 231 right · 0 wrong · AUROC 0.811

    Non-hallucination with “I don't know” 86.0% · answered 46.5%

    Logic 46.0% · Math 65.2%

    Its run record (Method) →

    86.0%46.5%18.7%
  6. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Kept at ≥99%: 7 answers, 7 right · 0 wrong · AUROC 0.648

    Non-hallucination with “I don't know” 82.5% · answered 29.6%

    Logic 30.7% · Math 37.1%

    Its run record (Method) →

    82.5%29.6%50.6%
  7. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.520

    Non-hallucination with “I don't know” 73.9% · answered 31.7%

    Logic 23.2% · Math 20.6%

    Its run record (Method) →

    73.9%31.7%76.0%
  8. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Kept at ≥99%: 520 answers, 518 right · 2 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 71.4% · answered 69.4%

    Logic 54.5% · Math 74.0%

    Its run record (Method) →

    71.4%69.4%17.7%
  9. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Kept at ≥99%: 236 answers, 235 right · 1 wrong · AUROC 0.797

    Non-hallucination with “I don't know” 69.4% · answered 60.3%

    Logic 46.4% · Math 61.3%

    Its run record (Method) →

    69.4%60.3%29.0%
  10. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 169 answers, 169 right · 0 wrong · AUROC 0.812

    Non-hallucination with “I don't know” 66.9% · answered 65.1%

    Logic 49.2% · Math 65.5%

    Its run record (Method) →

    66.9%65.1%26.5%
  11. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Kept at ≥99%: 433 answers, 430 right · 3 wrong · AUROC 0.827

    Non-hallucination with “I don't know” 58.3% · answered 73.2%

    Logic 52.4% · Math 68.6%

    Its run record (Method) →

    58.3%73.2%26.2%
  12. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 213 answers, 213 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 49.2% · answered 79.5%

    Logic 54.5% · Math 70.8%

    Its run record (Method) →

    49.2%79.5%26.5%
  13. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.846

    Non-hallucination with “I don't know” 48.3% · answered 79.2%

    Logic 54.8% · Math 70.1%

    Its run record (Method) →

    48.3%79.2%28.1%
  14. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 176 answers, 176 right · 0 wrong · AUROC 0.843

    Non-hallucination with “I don't know” 42.3% · answered 82.8%

    Logic 55.2% · Math 69.9%

    Its run record (Method) →

    42.3%82.8%28.4%
  15. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 274 answers, 272 right · 2 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 31.9% · answered 88.5%

    Logic 58.4% · Math 72.0%

    Its run record (Method) →

    31.9%88.5%27.7%
  16. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Kept at ≥99%: 207 answers, 207 right · 0 wrong · AUROC 0.789

    Non-hallucination with “I don't know” 28.1% · answered 85.3%

    Logic 41.9% · Math 59.0%

    Its run record (Method) →

    28.1%85.3%43.9%
  17. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Kept at ≥99%: 105 answers, 105 right · 0 wrong · AUROC 0.786

    Non-hallucination with “I don't know” 26.9% · answered 86.5%

    Logic 47.8% · Math 57.9%

    Its run record (Method) →

    26.9%86.5%42.6%
  18. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.854

    Non-hallucination with “I don't know” 25.8% · answered 90.1%

    Logic 52.5% · Math 69.3%

    Its run record (Method) →

    25.8%90.1%31.7%
  19. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Kept at ≥99%: 30 answers, 29 right · 1 wrong · AUROC 0.637

    Non-hallucination with “I don't know” 23.1% · answered 84.1%

    Logic 32.3% · Math 36.8%

    Its run record (Method) →

    23.1%84.1%63.0%
  20. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.602

    Non-hallucination with “I don't know” 22.7% · answered 83.2%

    Logic 29.2% · Math 32.1%

    Its run record (Method) →

    22.7%83.2%68.6%
  21. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 190 answers, 185 right · 5 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 18.9% · answered 90.0%

    Logic 43.1% · Math 55.2%

    Its run record (Method) →

    18.9%90.0%47.7%
  22. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Kept at ≥99%: 53 answers, 52 right · 1 wrong · AUROC 0.737

    Non-hallucination with “I don't know” 17.1% · answered 89.8%

    Logic 39.7% · Math 46.9%

    Its run record (Method) →

    17.1%89.8%55.0%
  23. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Kept at ≥99%: 4 answers, 4 right · 0 wrong · AUROC 0.675

    Non-hallucination with “I don't know” 16.4% · answered 88.9%

    Logic 30.8% · Math 38.7%

    Its run record (Method) →

    16.4%88.9%63.4%
  24. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Kept at ≥99%: No answers at this threshold · AUROC 0.511

    Non-hallucination with “I don't know” 15.6% · answered 87.3%

    Logic 23.6% · Math 22.7%

    Its run record (Method) →

    15.6%87.3%78.3%
  25. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 263 answers, 263 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 15.4% · answered 93.3%

    Logic 48.2% · Math 65.1%

    Its run record (Method) →

    15.4%93.3%39.3%
  26. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 131 answers, 130 right · 1 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 15.0% · answered 92.4%

    Logic 44.7% · Math 55.9%

    Its run record (Method) →

    15.0%92.4%46.5%
  27. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: No answers at this threshold · AUROC 0.605

    Non-hallucination with “I don't know” 14.9% · answered 88.9%

    Logic 24.7% · Math 29.7%

    Its run record (Method) →

    14.9%88.9%71.5%
  28. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Kept at ≥99%: No answers at this threshold · AUROC 0.759

    Non-hallucination with “I don't know” 14.5% · answered 92.4%

    Logic 42.6% · Math 54.6%

    Its run record (Method) →

    14.5%92.4%48.2%
  29. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Kept at ≥99%: 117 answers, 117 right · 0 wrong · AUROC 0.763

    Non-hallucination with “I don't know” 14.4% · answered 92.6%

    Logic 45.9% · Math 55.8%

    Its run record (Method) →

    14.4%92.6%47.3%
  30. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 74 answers, 74 right · 0 wrong · AUROC 0.798

    Non-hallucination with “I don't know” 13.5% · answered 93.7%

    Logic 48.2% · Math 59.8%

    Its run record (Method) →

    13.5%93.7%42.7%
  31. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 385 answers, 385 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 13.5% · answered 95.1%

    Logic 54.8% · Math 72.5%

    Its run record (Method) →

    13.5%95.1%33.1%
  32. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Kept at ≥99%: 47 answers, 47 right · 0 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 11.4% · answered 94.5%

    Logic 44.4% · Math 59.4%

    Its run record (Method) →

    11.4%94.5%45.4%
  33. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: No answers at this threshold · AUROC 0.786

    Non-hallucination with “I don't know” 10.4% · answered 95.0%

    Logic 43.9% · Math 60.1%

    Its run record (Method) →

    10.4%95.0%45.0%
  34. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 411 answers, 409 right · 2 wrong · AUROC 0.849

    Non-hallucination with “I don't know” 10.3% · answered 96.1%

    Logic 53.3% · Math 69.8%

    Its run record (Method) →

    10.3%96.1%34.9%
  35. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 313 answers, 313 right · 0 wrong · AUROC 0.817

    Non-hallucination with “I don't know” 10.2% · answered 95.5%

    Logic 46.3% · Math 64.1%

    Its run record (Method) →

    10.2%95.5%41.2%
  36. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 372 answers, 356 right · 16 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 10.1% · answered 94.9%

    Logic 45.1% · Math 53.5%

    Its run record (Method) →

    10.1%94.9%48.3%
  37. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Kept at ≥99%: 63 answers, 63 right · 0 wrong · AUROC 0.779

    Non-hallucination with “I don't know” 9.6% · answered 95.4%

    Logic 46.6% · Math 58.4%

    Its run record (Method) →

    9.6%95.4%45.1%
  38. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 217 answers, 216 right · 1 wrong · AUROC 0.858

    Non-hallucination with “I don't know” 9.3% · answered 96.6%

    Logic 54.5% · Math 70.4%

    Its run record (Method) →

    9.3%96.6%34.3%
  39. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 165 answers, 161 right · 4 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 8.9% · answered 95.2%

    Logic 39.7% · Math 51.5%

    Its run record (Method) →

    8.9%95.2%52.2%
  40. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 7.9% · answered 96.1%

    Logic 44.1% · Math 56.8%

    Its run record (Method) →

    7.9%96.1%46.9%
  41. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 194 answers, 188 right · 6 wrong · AUROC 0.743

    Non-hallucination with “I don't know” 7.8% · answered 95.8%

    Logic 40.4% · Math 50.4%

    Its run record (Method) →

    7.8%95.8%52.0%
  42. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.835

    Non-hallucination with “I don't know” 7.5% · answered 97.4%

    Logic 54.6% · Math 71.5%

    Its run record (Method) →

    7.5%97.4%33.5%
  43. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Kept at ≥99%: No answers at this threshold · AUROC 0.729

    Non-hallucination with “I don't know” 7.3% · answered 95.7%

    Logic 39.3% · Math 44.3%

    Its run record (Method) →

    7.3%95.7%56.8%
  44. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 167 answers, 165 right · 2 wrong · AUROC 0.765

    Non-hallucination with “I don't know” 7.1% · answered 96.4%

    Logic 44.4% · Math 55.3%

    Its run record (Method) →

    7.1%96.4%48.7%
  45. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 253 answers, 251 right · 2 wrong · AUROC 0.802

    Non-hallucination with “I don't know” 7.0% · answered 96.9%

    Logic 46.4% · Math 62.1%

    Its run record (Method) →

    7.0%96.9%43.0%
  46. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.707

    Non-hallucination with “I don't know” 6.9% · answered 96.2%

    Logic 38.9% · Math 49.8%

    Its run record (Method) →

    6.9%96.2%53.7%
  47. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Kept at ≥99%: 16 answers, 16 right · 0 wrong · AUROC 0.626

    Non-hallucination with “I don't know” 6.8% · answered 95.3%

    Logic 31.7% · Math 35.3%

    Its run record (Method) →

    6.8%95.3%66.5%
  48. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 208 answers, 207 right · 1 wrong · AUROC 0.757

    Non-hallucination with “I don't know” 6.4% · answered 96.7%

    Logic 40.8% · Math 55.6%

    Its run record (Method) →

    6.4%96.7%50.5%
  49. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Kept at ≥99%: 266 answers, 263 right · 3 wrong · AUROC 0.795

    Non-hallucination with “I don't know” 6.1% · answered 97.1%

    Logic 45.3% · Math 58.8%

    Its run record (Method) →

    6.1%97.1%45.4%
  50. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Kept at ≥99%: 884 answers, 866 right · 18 wrong · AUROC 0.841

    Non-hallucination with “I don't know” 5.7% · answered 97.9%

    Logic 53.1% · Math 70.3%

    Its run record (Method) →

    5.7%97.9%34.7%
  51. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Kept at ≥99%: 1,009 answers, 1,006 right · 3 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 5.7% · answered 98.5%

    Logic 60.7% · Math 81.6%

    Its run record (Method) →

    5.7%98.5%25.5%
  52. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.573

    Non-hallucination with “I don't know” 5.0% · answered 96.3%

    Logic 22.4% · Math 28.7%

    Its run record (Method) →

    5.0%96.3%73.8%
  53. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 4.5% · answered 98.2%

    Logic 50.6% · Math 66.3%

    Its run record (Method) →

    4.5%98.2%38.9%
  54. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 23 answers, 23 right · 0 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 4.4% · answered 98.6%

    Logic 57.8% · Math 75.2%

    Its run record (Method) →

    4.4%98.6%30.0%
  55. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Kept at ≥99%: 72 answers, 71 right · 1 wrong · AUROC 0.752

    Non-hallucination with “I don't know” 4.4% · answered 97.8%

    Logic 42.3% · Math 56.0%

    Its run record (Method) →

    4.4%97.8%49.0%
  56. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 296 answers, 294 right · 2 wrong · AUROC 0.865

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 57.9% · Math 77.1%

    Its run record (Method) →

    3.8%98.9%28.5%
  57. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 229 answers, 229 right · 0 wrong · AUROC 0.878

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 59.3% · Math 78.0%

    Its run record (Method) →

    3.8%98.9%28.0%
  58. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 153 answers, 153 right · 0 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 3.4% · answered 98.4%

    Logic 44.3% · Math 59.8%

    Its run record (Method) →

    3.4%98.4%45.5%
  59. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Kept at ≥99%: 281 answers, 270 right · 11 wrong · AUROC 0.776

    Non-hallucination with “I don't know” 3.1% · answered 98.5%

    Logic 43.3% · Math 56.0%

    Its run record (Method) →

    3.1%98.5%46.7%
  60. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Kept at ≥99%: 257 answers, 257 right · 0 wrong · AUROC 0.838

    Non-hallucination with “I don't know” 3.0% · answered 98.9%

    Logic 50.0% · Math 71.3%

    Its run record (Method) →

    3.0%98.9%36.5%
  61. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Kept at ≥99%: 18 answers, 18 right · 0 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 2.4% · answered 98.8%

    Logic 40.8% · Math 51.1%

    Its run record (Method) →

    2.4%98.8%51.4%
  62. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.576

    Non-hallucination with “I don't know” 2.0% · answered 98.5%

    Logic 27.0% · Math 28.2%

    Its run record (Method) →

    2.0%98.5%72.2%
  63. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.659

    Non-hallucination with “I don't know” 2.0% · answered 98.7%

    Logic 32.1% · Math 39.2%

    Its run record (Method) →

    2.0%98.7%64.3%
  64. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 50 answers, 50 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 1.9% · answered 99.3%

    Logic 52.3% · Math 69.0%

    Its run record (Method) →

    1.9%99.3%35.0%
  65. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Kept at ≥99%: 384 answers, 384 right · 0 wrong · AUROC 0.873

    Non-hallucination with “I don't know” 1.8% · answered 99.5%

    Logic 58.7% · Math 77.3%

    Its run record (Method) →

    1.8%99.5%28.1%
  66. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Kept at ≥99%: 30 answers, 30 right · 0 wrong · AUROC 0.770

    Non-hallucination with “I don't know” 1.6% · answered 99.2%

    Logic 40.6% · Math 53.8%

    Its run record (Method) →

    1.6%99.2%50.6%
  67. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 554 answers, 553 right · 1 wrong · AUROC 0.870

    Non-hallucination with “I don't know” 0.7% · answered 99.8%

    Logic 59.0% · Math 77.4%

    Its run record (Method) →

    0.7%99.8%28.4%
  68. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.590

    Non-hallucination with “I don't know” 0.6% · answered 99.5%

    Logic 26.7% · Math 28.2%

    Its run record (Method) →

    0.6%99.5%72.4%
  69. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Kept at ≥99%: 524 answers, 523 right · 1 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 0.1% · answered 100.0%

    Logic 58.9% · Math 80.3%

    Its run record (Method) →

    0.1%100.0%26.6%

Liquid AI Celeris Fastino Base Labs Subquadratic Nace.AI Perplexity EldanRing StartLux Other TypeSafe Zefan Cai tattrongvu Microsoft PelaAI Inception vLLM Semantic Router victorbennett scar-ai quincyqiang Blockbrain Labs Valen-Team newsbang Cloudflare Patrick-18 MachinePulse Strands Agents Logits Sthānika AI REAX Apertix AI Google OmniJev Metask Lab Turion.AI Poindexter Labs A setup that always chose F would reach 100% with no right answers.

Saying “I don't know”, or held back by confidence

Each setup's non-hallucination rate with F, and its five-option run held back by its own confidence at about the same attempt rate (it answers only where the chosen option's probability reaches the cut-off that keeps that share; tb-next's derived rate) · higher is better

  1. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 128 answers, 128 right · 0 wrong · AUROC 0.856

    Non-hallucination with “I don't know” 90.2% · answered 48.1%

    Logic 51.6% · Math 69.9%

    Its run record (Method) →

    90.2%92.0%
  2. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Kept at ≥99%: 233 answers, 233 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 89.1% · answered 52.3%

    Logic 54.9% · Math 74.1%

    Its run record (Method) →

    89.1%91.4%
  3. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.829

    Non-hallucination with “I don't know” 87.2% · answered 50.2%

    Logic 47.3% · Math 70.0%

    Its run record (Method) →

    87.2%88.2%
  4. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: No answers at this threshold · AUROC 0.830

    Non-hallucination with “I don't know” 86.7% · answered 50.8%

    Logic 47.3% · Math 69.9%

    Its run record (Method) →

    86.7%87.5%
  5. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 231 answers, 231 right · 0 wrong · AUROC 0.811

    Non-hallucination with “I don't know” 86.0% · answered 46.5%

    Logic 46.0% · Math 65.2%

    Its run record (Method) →

    86.0%87.5%
  6. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Kept at ≥99%: 7 answers, 7 right · 0 wrong · AUROC 0.648

    Non-hallucination with “I don't know” 82.5% · answered 29.6%

    Logic 30.7% · Math 37.1%

    Its run record (Method) →

    82.5%83.1%
  7. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.520

    Non-hallucination with “I don't know” 73.9% · answered 31.7%

    Logic 23.2% · Math 20.6%

    Its run record (Method) →

    73.9%73.5%
  8. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Kept at ≥99%: 520 answers, 518 right · 2 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 71.4% · answered 69.4%

    Logic 54.5% · Math 74.0%

    Its run record (Method) →

    71.4%72.8%
  9. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Kept at ≥99%: 236 answers, 235 right · 1 wrong · AUROC 0.797

    Non-hallucination with “I don't know” 69.4% · answered 60.3%

    Logic 46.4% · Math 61.3%

    Its run record (Method) →

    69.4%70.7%
  10. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 169 answers, 169 right · 0 wrong · AUROC 0.812

    Non-hallucination with “I don't know” 66.9% · answered 65.1%

    Logic 49.2% · Math 65.5%

    Its run record (Method) →

    66.9%67.6%
  11. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Kept at ≥99%: 433 answers, 430 right · 3 wrong · AUROC 0.827

    Non-hallucination with “I don't know” 58.3% · answered 73.2%

    Logic 52.4% · Math 68.6%

    Its run record (Method) →

    58.3%59.0%
  12. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 213 answers, 213 right · 0 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 49.2% · answered 79.5%

    Logic 54.5% · Math 70.8%

    Its run record (Method) →

    49.2%50.4%
  13. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.846

    Non-hallucination with “I don't know” 48.3% · answered 79.2%

    Logic 54.8% · Math 70.1%

    Its run record (Method) →

    48.3%50.6%
  14. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 176 answers, 176 right · 0 wrong · AUROC 0.843

    Non-hallucination with “I don't know” 42.3% · answered 82.8%

    Logic 55.2% · Math 69.9%

    Its run record (Method) →

    42.3%42.5%
  15. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Kept at ≥99%: 274 answers, 272 right · 2 wrong · AUROC 0.852

    Non-hallucination with “I don't know” 31.9% · answered 88.5%

    Logic 58.4% · Math 72.0%

    Its run record (Method) →

    31.9%32.1%
  16. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Kept at ≥99%: 207 answers, 207 right · 0 wrong · AUROC 0.789

    Non-hallucination with “I don't know” 28.1% · answered 85.3%

    Logic 41.9% · Math 59.0%

    Its run record (Method) →

    28.1%29.0%
  17. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Kept at ≥99%: 105 answers, 105 right · 0 wrong · AUROC 0.786

    Non-hallucination with “I don't know” 26.9% · answered 86.5%

    Logic 47.8% · Math 57.9%

    Its run record (Method) →

    26.9%27.7%
  18. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.854

    Non-hallucination with “I don't know” 25.8% · answered 90.1%

    Logic 52.5% · Math 69.3%

    Its run record (Method) →

    25.8%25.7%
  19. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Kept at ≥99%: 30 answers, 29 right · 1 wrong · AUROC 0.637

    Non-hallucination with “I don't know” 23.1% · answered 84.1%

    Logic 32.3% · Math 36.8%

    Its run record (Method) →

    23.1%23.2%
  20. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.602

    Non-hallucination with “I don't know” 22.7% · answered 83.2%

    Logic 29.2% · Math 32.1%

    Its run record (Method) →

    22.7%23.0%
  21. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 190 answers, 185 right · 5 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 18.9% · answered 90.0%

    Logic 43.1% · Math 55.2%

    Its run record (Method) →

    18.9%19.6%
  22. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Kept at ≥99%: 53 answers, 52 right · 1 wrong · AUROC 0.737

    Non-hallucination with “I don't know” 17.1% · answered 89.8%

    Logic 39.7% · Math 46.9%

    Its run record (Method) →

    17.1%17.7%
  23. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Kept at ≥99%: 4 answers, 4 right · 0 wrong · AUROC 0.675

    Non-hallucination with “I don't know” 16.4% · answered 88.9%

    Logic 30.8% · Math 38.7%

    Its run record (Method) →

    16.4%16.6%
  24. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Kept at ≥99%: No answers at this threshold · AUROC 0.511

    Non-hallucination with “I don't know” 15.6% · answered 87.3%

    Logic 23.6% · Math 22.7%

    Its run record (Method) →

    15.6%15.8%
  25. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 263 answers, 263 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 15.4% · answered 93.3%

    Logic 48.2% · Math 65.1%

    Its run record (Method) →

    15.4%17.8%
  26. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Kept at ≥99%: 131 answers, 130 right · 1 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 15.0% · answered 92.4%

    Logic 44.7% · Math 55.9%

    Its run record (Method) →

    15.0%15.4%
  27. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: No answers at this threshold · AUROC 0.605

    Non-hallucination with “I don't know” 14.9% · answered 88.9%

    Logic 24.7% · Math 29.7%

    Its run record (Method) →

    14.9%15.1%
  28. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Kept at ≥99%: No answers at this threshold · AUROC 0.759

    Non-hallucination with “I don't know” 14.5% · answered 92.4%

    Logic 42.6% · Math 54.6%

    Its run record (Method) →

    14.5%14.8%
  29. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Kept at ≥99%: 117 answers, 117 right · 0 wrong · AUROC 0.763

    Non-hallucination with “I don't know” 14.4% · answered 92.6%

    Logic 45.9% · Math 55.8%

    Its run record (Method) →

    14.4%14.8%
  30. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 74 answers, 74 right · 0 wrong · AUROC 0.798

    Non-hallucination with “I don't know” 13.5% · answered 93.7%

    Logic 48.2% · Math 59.8%

    Its run record (Method) →

    13.5%13.8%
  31. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 385 answers, 385 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 13.5% · answered 95.1%

    Logic 54.8% · Math 72.5%

    Its run record (Method) →

    13.5%14.2%
  32. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Kept at ≥99%: 47 answers, 47 right · 0 wrong · AUROC 0.769

    Non-hallucination with “I don't know” 11.4% · answered 94.5%

    Logic 44.4% · Math 59.4%

    Its run record (Method) →

    11.4%11.7%
  33. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: No answers at this threshold · AUROC 0.786

    Non-hallucination with “I don't know” 10.4% · answered 95.0%

    Logic 43.9% · Math 60.1%

    Its run record (Method) →

    10.4%10.6%
  34. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Kept at ≥99%: 411 answers, 409 right · 2 wrong · AUROC 0.849

    Non-hallucination with “I don't know” 10.3% · answered 96.1%

    Logic 53.3% · Math 69.8%

    Its run record (Method) →

    10.3%10.6%
  35. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 313 answers, 313 right · 0 wrong · AUROC 0.817

    Non-hallucination with “I don't know” 10.2% · answered 95.5%

    Logic 46.3% · Math 64.1%

    Its run record (Method) →

    10.2%10.5%
  36. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 372 answers, 356 right · 16 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 10.1% · answered 94.9%

    Logic 45.1% · Math 53.5%

    Its run record (Method) →

    10.1%10.2%
  37. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Kept at ≥99%: 63 answers, 63 right · 0 wrong · AUROC 0.779

    Non-hallucination with “I don't know” 9.6% · answered 95.4%

    Logic 46.6% · Math 58.4%

    Its run record (Method) →

    9.6%9.8%
  38. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 217 answers, 216 right · 1 wrong · AUROC 0.858

    Non-hallucination with “I don't know” 9.3% · answered 96.6%

    Logic 54.5% · Math 70.4%

    Its run record (Method) →

    9.3%9.5%
  39. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 165 answers, 161 right · 4 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 8.9% · answered 95.2%

    Logic 39.7% · Math 51.5%

    Its run record (Method) →

    8.9%9.0%
  40. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.777

    Non-hallucination with “I don't know” 7.9% · answered 96.1%

    Logic 44.1% · Math 56.8%

    Its run record (Method) →

    7.9%8.0%
  41. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Kept at ≥99%: 194 answers, 188 right · 6 wrong · AUROC 0.743

    Non-hallucination with “I don't know” 7.8% · answered 95.8%

    Logic 40.4% · Math 50.4%

    Its run record (Method) →

    7.8%7.8%
  42. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.835

    Non-hallucination with “I don't know” 7.5% · answered 97.4%

    Logic 54.6% · Math 71.5%

    Its run record (Method) →

    7.5%7.6%
  43. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Kept at ≥99%: No answers at this threshold · AUROC 0.729

    Non-hallucination with “I don't know” 7.3% · answered 95.7%

    Logic 39.3% · Math 44.3%

    Its run record (Method) →

    7.3%7.3%
  44. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 167 answers, 165 right · 2 wrong · AUROC 0.765

    Non-hallucination with “I don't know” 7.1% · answered 96.4%

    Logic 44.4% · Math 55.3%

    Its run record (Method) →

    7.1%7.3%
  45. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 253 answers, 251 right · 2 wrong · AUROC 0.802

    Non-hallucination with “I don't know” 7.0% · answered 96.9%

    Logic 46.4% · Math 62.1%

    Its run record (Method) →

    7.0%7.1%
  46. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.707

    Non-hallucination with “I don't know” 6.9% · answered 96.2%

    Logic 38.9% · Math 49.8%

    Its run record (Method) →

    6.9%6.9%
  47. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Kept at ≥99%: 16 answers, 16 right · 0 wrong · AUROC 0.626

    Non-hallucination with “I don't know” 6.8% · answered 95.3%

    Logic 31.7% · Math 35.3%

    Its run record (Method) →

    6.8%6.9%
  48. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Kept at ≥99%: 208 answers, 207 right · 1 wrong · AUROC 0.757

    Non-hallucination with “I don't know” 6.4% · answered 96.7%

    Logic 40.8% · Math 55.6%

    Its run record (Method) →

    6.4%6.7%
  49. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Kept at ≥99%: 266 answers, 263 right · 3 wrong · AUROC 0.795

    Non-hallucination with “I don't know” 6.1% · answered 97.1%

    Logic 45.3% · Math 58.8%

    Its run record (Method) →

    6.1%6.2%
  50. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Kept at ≥99%: 884 answers, 866 right · 18 wrong · AUROC 0.841

    Non-hallucination with “I don't know” 5.7% · answered 97.9%

    Logic 53.1% · Math 70.3%

    Its run record (Method) →

    5.7%5.7%
  51. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Kept at ≥99%: 1,009 answers, 1,006 right · 3 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 5.7% · answered 98.5%

    Logic 60.7% · Math 81.6%

    Its run record (Method) →

    5.7%5.8%
  52. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.573

    Non-hallucination with “I don't know” 5.0% · answered 96.3%

    Logic 22.4% · Math 28.7%

    Its run record (Method) →

    5.0%5.0%
  53. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.810

    Non-hallucination with “I don't know” 4.5% · answered 98.2%

    Logic 50.6% · Math 66.3%

    Its run record (Method) →

    4.5%4.5%
  54. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 23 answers, 23 right · 0 wrong · AUROC 0.868

    Non-hallucination with “I don't know” 4.4% · answered 98.6%

    Logic 57.8% · Math 75.2%

    Its run record (Method) →

    4.4%4.4%
  55. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Kept at ≥99%: 72 answers, 71 right · 1 wrong · AUROC 0.752

    Non-hallucination with “I don't know” 4.4% · answered 97.8%

    Logic 42.3% · Math 56.0%

    Its run record (Method) →

    4.4%4.5%
  56. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 296 answers, 294 right · 2 wrong · AUROC 0.865

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 57.9% · Math 77.1%

    Its run record (Method) →

    3.8%3.8%
  57. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Kept at ≥99%: 229 answers, 229 right · 0 wrong · AUROC 0.878

    Non-hallucination with “I don't know” 3.8% · answered 98.9%

    Logic 59.3% · Math 78.0%

    Its run record (Method) →

    3.8%3.8%
  58. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Kept at ≥99%: 153 answers, 153 right · 0 wrong · AUROC 0.782

    Non-hallucination with “I don't know” 3.4% · answered 98.4%

    Logic 44.3% · Math 59.8%

    Its run record (Method) →

    3.4%3.5%
  59. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Kept at ≥99%: 281 answers, 270 right · 11 wrong · AUROC 0.776

    Non-hallucination with “I don't know” 3.1% · answered 98.5%

    Logic 43.3% · Math 56.0%

    Its run record (Method) →

    3.1%3.1%
  60. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Kept at ≥99%: 257 answers, 257 right · 0 wrong · AUROC 0.838

    Non-hallucination with “I don't know” 3.0% · answered 98.9%

    Logic 50.0% · Math 71.3%

    Its run record (Method) →

    3.0%3.1%
  61. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Kept at ≥99%: 18 answers, 18 right · 0 wrong · AUROC 0.747

    Non-hallucination with “I don't know” 2.4% · answered 98.8%

    Logic 40.8% · Math 51.1%

    Its run record (Method) →

    2.4%2.4%
  62. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.576

    Non-hallucination with “I don't know” 2.0% · answered 98.5%

    Logic 27.0% · Math 28.2%

    Its run record (Method) →

    2.0%2.0%
  63. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Kept at ≥99%: No answers at this threshold · AUROC 0.659

    Non-hallucination with “I don't know” 2.0% · answered 98.7%

    Logic 32.1% · Math 39.2%

    Its run record (Method) →

    2.0%2.0%
  64. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 50 answers, 50 right · 0 wrong · AUROC 0.844

    Non-hallucination with “I don't know” 1.9% · answered 99.3%

    Logic 52.3% · Math 69.0%

    Its run record (Method) →

    1.9%1.8%
  65. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Kept at ≥99%: 384 answers, 384 right · 0 wrong · AUROC 0.873

    Non-hallucination with “I don't know” 1.8% · answered 99.5%

    Logic 58.7% · Math 77.3%

    Its run record (Method) →

    1.8%1.9%
  66. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Kept at ≥99%: 30 answers, 30 right · 0 wrong · AUROC 0.770

    Non-hallucination with “I don't know” 1.6% · answered 99.2%

    Logic 40.6% · Math 53.8%

    Its run record (Method) →

    1.6%1.6%
  67. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Kept at ≥99%: 554 answers, 553 right · 1 wrong · AUROC 0.870

    Non-hallucination with “I don't know” 0.7% · answered 99.8%

    Logic 59.0% · Math 77.4%

    Its run record (Method) →

    0.7%0.7%
  68. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.590

    Non-hallucination with “I don't know” 0.6% · answered 99.5%

    Logic 26.7% · Math 28.2%

    Its run record (Method) →

    0.6%0.6%
  69. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Kept at ≥99%: 524 answers, 523 right · 1 wrong · AUROC 0.882

    Non-hallucination with “I don't know” 0.1% · answered 100.0%

    Logic 58.9% · Math 80.3%

    Its run record (Method) →

    0.1%0.1%

Liquid AI Celeris Fastino Base Labs Subquadratic Nace.AI Perplexity EldanRing StartLux Other TypeSafe Zefan Cai tattrongvu Microsoft PelaAI Inception vLLM Semantic Router victorbennett scar-ai quincyqiang Blockbrain Labs Valen-Team newsbang Cloudflare Patrick-18 MachinePulse Strands Agents Logits Sthānika AI REAX Apertix AI Google OmniJev Metask Lab Turion.AI Poindexter Labs Solid: with F Striped: held back by its own confidence

Counts with F on offer

SetupWebNquestions answeredRightWronga letter A–E, or noneI don't knowoption FNon-hallucinationof answers not right, % “I don't know” · higher is better · F / (F + wrong)Answerednot “I don't know”: (right + wrong) / NError rateof its answers: wrong / (right + wrong) · lower is betterAccuracy when answeringright / (right + wrong)Held back by confidencenon-hallucination at the same attempt rate
d1.2-ultra Closed · Undisclosed—3,2881,3961851,70790.2%48.1%11.7%88.3%92.0%
d1-ultra Closed · Efficient—3,2881,5251931,57089.1%52.3%11.2%88.8%91.4%
celeris-1-decision Closed · Efficient—3,2881,4092411,63887.2%50.2%14.6%85.4%88.2%
celeris-1.1-decision Closed · Efficient—3,2881,4212481,61986.7%50.8%14.9%85.1%87.5%
d1.1 Closed · Efficient—3,2881,2422861,76086.0%46.5%18.7%81.3%87.5%
d1-2B Open · 1.9B—3,2884814922,31582.5%29.6%50.6%49.4%83.1%
GLiDE 0.4B Open · 0.4B—3,2882507932,24573.9%31.7%76.0%24.0%73.5%
Mammoth-1 Open · 27B—3,2881,8774041,00771.4%69.4%17.7%82.3%72.8%
Elephant-1 Open · 9.0B—3,2881,4075751,30669.4%60.3%29.0%71.0%70.7%
d1.2 Closed · Undisclosed—3,2881,5725681,14866.9%65.1%26.5%73.5%67.6%
SubQ Snap 1.1 Closed · Efficient—3,2881,77663088258.3%73.2%26.2%73.8%59.0%
GLiDE API Closed · Efficient—3,2881,92169467349.2%79.5%26.5%73.5%50.4%
Drex Max v1.1 Closed · Efficient (provisional)—3,2881,87373268348.3%79.2%28.1%71.9%50.6%
GLiDE v1.2 Open · 27B—3,2881,95177256542.3%82.8%28.4%71.6%42.5%
GLiDE 27B Open · 27B—3,2882,10680537731.9%88.5%27.7%72.3%32.1%
Drex 2.0 Open · 35B MoE · 3.0B active—3,2881,5751,23148228.1%85.3%43.9%56.1%29.0%
GLiDE 9B Open · 7.9B—3,2881,6321,21144526.9%86.5%42.6%57.4%27.7%
Perplexity Decider 27B v1.2 API · with web Open · 27Bwith web3,2882,02393832725.8%90.1%31.7%68.3%25.7%
GLiDE 2B Open · 1.9B—3,2881,0231,74252323.1%84.1%63.0%37.0%23.2%
GLiDE 0.8B Open · 0.8B—3,2888601,87755122.7%83.2%68.6%31.4%23.0%
Perplexity Decider Flash v1.2 Open · 4.0B—3,2881,5491,41032918.9%90.0%47.7%52.3%19.6%
Winnow-12B Open · 12B—3,2881,3281,62533517.1%89.8%55.0%45.0%17.7%
StartLux-Decision-v1.1-2B-Instant Open · 2.0B—3,2881,0701,85436416.4%88.9%63.4%36.6%16.6%
GLiClass v4 Edge Open · 0.4B—3,2886242,24841615.6%87.3%78.3%21.7%15.8%
Jev 1.14 Closed · Efficient—3,2881,8621,20721915.4%93.3%39.3%60.7%17.8%
Perplexity Decider Flash v1.3 Open · 4.0B—3,2881,6241,41425015.0%92.4%46.5%53.5%15.4%
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B—3,2888332,08936614.9%88.9%71.5%28.5%15.1%
Open-Jev-27B-v1.1 Open · 27B—3,2881,5731,46624914.5%92.4%48.2%51.8%14.8%
StartLux-Decision-v1.1-4B-Instant Open · 4.0B—3,2881,6061,44024214.4%92.6%47.3%52.7%14.8%
Jeffan-9B-1211 Open · 9.0B—3,2881,7671,31520613.5%93.7%42.7%57.3%13.8%
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B—3,2882,0901,03616213.5%95.1%33.1%66.9%14.2%
Microsoft-Decision-1 Closed · Efficient—3,2881,6961,41118111.4%94.5%45.4%54.6%11.7%
KnowLine-9B-Gen2 Open · 9.0B—3,2881,7171,40716410.4%95.0%45.0%55.0%10.6%
Perplexity Decider 27B v1.2 API Open · 27B—3,2882,0581,10312710.3%96.1%34.9%65.1%10.6%
Jev 1.13 Closed · Efficient—3,2881,8481,29314710.2%95.5%41.2%58.8%10.5%
Mercury Decide Closed · Efficient—3,2881,6141,50516910.1%94.9%48.3%51.7%10.2%
StartLux-Decision-v1.1-9B-Instant Open · 9.0B—3,2881,7221,4151519.6%95.4%45.1%54.9%9.8%
d3 Open · 26B—3,2882,0881,0881129.3%96.6%34.3%65.7%9.5%
Verdin-4B-v1.1 Open · 4.0B—3,2881,4961,6331598.9%95.2%52.2%47.8%9.0%
vera-medium-omni Open · 4.2B—3,2881,6771,4841277.9%96.1%46.9%53.1%8.0%
Chinese Decision Pointer 4B Open · 4.0B—3,2881,5121,6381387.8%95.8%52.0%48.0%7.8%
d3-ultra Open · 26B—3,2882,1281,073877.5%97.4%33.5%66.5%7.6%
Cygnet Open · 12B—3,2881,3591,7891407.3%95.7%56.8%43.2%7.3%
Valen-Decision-1.5-9B Open · 9.0B—3,2881,6261,5441187.1%96.4%48.7%51.3%7.3%
Adjudex 9B v5 Open · 9.0B—3,2881,8151,3701037.0%96.9%43.0%57.0%7.1%
Clef-Flash Open · 9.0B—3,2881,4641,6991256.9%96.2%53.7%46.3%6.9%
KnowLine-2B-Gen1 Open · 2.0B—3,2881,0492,0861536.8%95.3%66.5%33.5%6.9%
d1 Closed · Efficient—3,2881,5721,6061106.4%96.7%50.5%49.5%6.7%
Dexy-Decision-9B-V2 Open · 9.0B—3,2881,7431,450956.1%97.1%45.4%54.6%6.2%
Drex Max Open · 27B—3,2882,1031,117685.7%97.9%34.7%65.3%5.7%
Karpo Decision 31B Open · 31B—3,2882,413825505.7%98.5%25.5%74.5%5.8%
Strands Decider 2B Open · 2.0B—3,2888302,3351235.0%96.3%73.8%26.2%5.0%
KnowLine-12B-Gen1 Open · 12B—3,2881,9741,255594.5%98.2%38.9%61.1%4.5%
Logits Sigma-1 Duo Open · 57B—3,2882,270973454.4%98.6%30.0%70.0%4.4%
KnowLine 4B Gen5.5 Open · 4.0B—3,2881,6391,577724.4%97.8%49.0%51.0%4.5%
Sieve 31B v3 Open · 31B—3,2882,325926373.8%98.9%28.5%71.5%3.8%
REAX 1.3 Open · 57B—3,2882,343909363.8%98.9%28.0%72.0%3.8%
KnowLine-9B-Gen1 Open · 9.0B—3,2881,7651,471523.4%98.4%45.5%54.5%3.5%
Cerno 9B v1.2 Open · 9.0B—3,2881,7281,511493.1%98.5%46.7%53.3%3.1%
Gemini Decision 1 20261111 Closed · Efficient—3,2882,0661,185373.0%98.9%36.5%63.5%3.1%
Clef Open · 27B—3,2881,5781,669412.4%98.8%51.4%48.6%2.4%
OneJev1.6-0.8B Open · 0.8B—3,2889022,338482.0%98.5%72.2%27.8%2.0%
Metask-Jev-4B Open · 4.5B—3,2881,1582,088422.0%98.7%64.3%35.7%2.0%
Turion Jev 31B Open · 31B—3,2882,1231,143221.9%99.3%35.0%65.0%1.8%
Copernicus-31B Open · 31B—3,2882,353918171.8%99.5%28.1%71.9%1.9%
OneJev-27B Open · 27B—3,2881,6121,650261.6%99.2%50.6%49.4%1.6%
KnowLine-31B-Gen1.5 Open · 31B—3,2882,34993270.7%99.8%28.4%71.6%0.7%
KnowLine-0.8B-Gen1 Open · 0.8B—3,2889022,371150.6%99.5%72.4%27.6%0.6%
KnowLine-31B-Gen2 Open · 31B—3,2882,41487310.1%100.0%26.6%73.4%0.1%

SubQ Snap Preview and SubQ Snap 1.1 returned the same answer to every question (and the same probabilities on 3,276 of 3,288); shown once.

Perplexity Decider 27B v1.2 (API) and Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell): two setups of the same model, one on an NVIDIA RTX PRO 6000 Blackwell (96 GB) and one through Perplexity's API; not verified to be identical weights or settings. Its row is the API setup on every test; Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell) is under the row's other settings and All setups.

Every setup, every measure

SetupWebAccuracy% of N (N ≤ 3,288) · Wilson 95%Tie groupHolm · McNemarRight / NquestionsKept at ≥99%right / wrongAUROCright vs wrongNon-hallucinationof answers not right, % “I don't know” · higher is betterMedian latencymsp90ms, nearest rankCost$ per 1,000 qper 1M q
Karpo Decision 31B Open · 31B

Karpo Decision 31B · MachinePulse · decision model

Parameters: 31B dense

Kept at ≥99%: 1,009 answers, 1,006 right · 3 wrong · AUROC 0.882

Non-hallucination with “I don't know” 5.7% · answered 98.5%

Logic 60.7% · Math 81.6%

Its run record (Method) →

—74.4%72.9%–75.9%a2,447 / 3,2881,006 right of 1,009 kept3 wrong · 2,279 skipped0.8825.7%answered 98%162 ms198 ms$0.118$118estimate · RTX PRO 6000 Blackwell
KnowLine-31B-Gen2 Open · 31B

KnowLine-31B-Gen2 · PelaAI · decision model

Parameters: 31B dense

Base model: Gemma 4 31B

Kept at ≥99%: 524 answers, 523 right · 1 wrong · AUROC 0.882

Non-hallucination with “I don't know” 0.1% · answered 100.0%

Logic 58.9% · Math 80.3%

Its run record (Method) →

—73.0%71.4%–74.5%ab2,399 / 3,288523 right of 524 kept1 wrong · 2,764 skipped0.8820.1%answered 100%116 ms177 ms$0.093$92.98estimate · RTX PRO 6000 Blackwell
REAX 1.3 Open · 57B

REAX 1.3 · REAX · decision model

Parameters: 57.36B dense

Kept at ≥99%: 229 answers, 229 right · 0 wrong · AUROC 0.878

Non-hallucination with “I don't know” 3.8% · answered 98.9%

Logic 59.3% · Math 78.0%

Its run record (Method) →

—71.6%70.0%–73.1%b2,354 / 3,288229 right of 229 kept0 mistakes · 3,059 skipped0.8783.8%answered 99%200 ms260 ms$0.148$148estimate · RTX PRO 6000 Blackwell
KnowLine-31B-Gen1.5 Open · 31B

KnowLine-31B-Gen1.5 · PelaAI · decision model

Parameters: 31B dense

Kept at ≥99%: 554 answers, 553 right · 1 wrong · AUROC 0.870

Non-hallucination with “I don't know” 0.7% · answered 99.8%

Logic 59.0% · Math 77.4%

Its run record (Method) →

—71.1%69.5%–72.6%bc2,338 / 3,288553 right of 554 kept1 wrong · 2,734 skipped0.8700.7%answered 100%811 ms1,111 ms$0.052$51.85estimate · DGX Spark
Copernicus-31B Open · 31B

Copernicus-31B · Poindexter Labs · decision model

Parameters: 31B dense

Kept at ≥99%: 384 answers, 384 right · 0 wrong · AUROC 0.873

Non-hallucination with “I don't know” 1.8% · answered 99.5%

Logic 58.7% · Math 77.3%

Its run record (Method) →

—71.0%69.4%–72.5%bc2,333 / 3,288384 right of 384 kept0 mistakes · 2,904 skipped0.8731.8%answered 99%128 ms218 ms$0.102$102estimate · RTX PRO 6000 Blackwell
Sieve 31B v3 Open · 31B

Sieve 31B v3 · Sthānika AI · decision model

Parameters: 31B dense

Kept at ≥99%: 296 answers, 294 right · 2 wrong · AUROC 0.865

Non-hallucination with “I don't know” 3.8% · answered 98.9%

Logic 57.9% · Math 77.1%

Its run record (Method) →

—70.5%68.9%–72.1%bcd2,319 / 3,288294 right of 296 kept2 wrong · 2,992 skipped0.8653.8%answered 99%676 ms1,173 ms$0.047$47.29estimate · DGX Spark
Logits Sigma-1 Duo Open · 57B

Logits Sigma-1 Duo · Logits · decision model

Parameters: 57.36B dense

Kept at ≥99%: 23 answers, 23 right · 0 wrong · AUROC 0.868

Non-hallucination with “I don't know” 4.4% · answered 98.6%

Logic 57.8% · Math 75.2%

Its run record (Method) →

—69.3%67.7%–70.8%cde2,277 / 3,28823 right of 23 kept0 mistakes · 3,265 skipped0.8684.4%answered 99%207 ms324 ms$0.165$165estimate · RTX PRO 6000 Blackwell
d1-ultra Closed · Efficient

d1-ultra · Liquid AI · decision model

Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

Kept at ≥99%: 233 answers, 233 right · 0 wrong · AUROC 0.852

Non-hallucination with “I don't know” 89.1% · answered 52.3%

Logic 54.9% · Math 74.1%

Its run record (Method) →

—67.5%65.9%–69.1%defg2,221 / 3,288233 right of 233 kept0 mistakes · 3,055 skipped0.85289.1%answered 52%180 ms426 ms$0.008$8.37
GLiDE 27B Open · 27B

GLiDE 27B · Fastino · decision model

Parameters: 27B dense

Kept at ≥99%: 274 answers, 272 right · 2 wrong · AUROC 0.852

Non-hallucination with “I don't know” 31.9% · answered 88.5%

Logic 58.4% · Math 72.0%

Its run record (Method) →

—67.3%65.7%–68.9%efh2,214 / 3,288272 right of 274 kept2 wrong · 3,014 skipped0.85231.9%answered 89%450 ms587 ms$0.029$28.55estimate · DGX Spark
Mammoth-1 Open · 27B

Mammoth-1 · Base Labs · decision model

Parameters: 27B dense

Kept at ≥99%: 520 answers, 518 right · 2 wrong · AUROC 0.868

Non-hallucination with “I don't know” 71.4% · answered 69.4%

Logic 54.5% · Math 74.0%

Its run record (Method) →

—67.3%65.7%–68.9%efghi2,213 / 3,288518 right of 520 kept2 wrong · 2,768 skipped0.86871.4%answered 69%150 ms232 ms$0.028$27.98 list$0.120$120estimate · RTX PRO 6000 Blackwell
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B

Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

Parameters: 27B dense

Kept at ≥99%: 385 answers, 385 right · 0 wrong · AUROC 0.844

Non-hallucination with “I don't know” 13.5% · answered 95.1%

Logic 54.8% · Math 72.5%

Its run record (Method) →

—66.4%64.8%–68.0%fghij2,184 / 3,288385 right of 385 kept0 mistakes · 2,903 skipped0.84413.5%answered 95%97 ms125 ms$0.071$71.10estimate · RTX PRO 6000 Blackwell
d3-ultra Open · 26B

d3-ultra · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.835

Non-hallucination with “I don't know” 7.5% · answered 97.4%

Logic 54.6% · Math 71.5%

Its run record (Method) →

—65.7%64.1%–67.3%fghijk2,161 / 3,28839 right of 39 kept0 mistakes · 3,249 skipped0.8357.5%answered 97%129 ms168 ms$0.096$95.71estimate · RTX PRO 6000 Blackwell
GLiDE API Closed · Efficient

GLiDE API · Fastino · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 213 answers, 213 right · 0 wrong · AUROC 0.852

Non-hallucination with “I don't know” 49.2% · answered 79.5%

Logic 54.5% · Math 70.8%

Its run record (Method) →

—65.2%63.6%–66.8%fghijkl2,144 / 3,288213 right of 213 kept0 mistakes · 3,075 skipped0.85249.2%answered 80%266 ms284 ms$0.036$36.42
d3 Open · 26B

d3 · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Kept at ≥99%: 217 answers, 216 right · 1 wrong · AUROC 0.858

Non-hallucination with “I don't know” 9.3% · answered 96.6%

Logic 54.5% · Math 70.4%

Its run record (Method) →

—65.0%63.3%–66.6%fghijkl2,136 / 3,288216 right of 217 kept1 wrong · 3,071 skipped0.8589.3%answered 97%57 ms86 ms$0.046$46.28estimate · RTX PRO 6000 Blackwell
Drex Max v1.1 Closed · Efficient (provisional)

Drex Max v1.1 · Nace.AI · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.846

Non-hallucination with “I don't know” 48.3% · answered 79.2%

Logic 54.8% · Math 70.1%

Its run record (Method) →

—64.8%63.2%–66.5%fghijkl2,132 / 3,288404 right of 405 kept1 wrong · 2,883 skipped0.84648.3%answered 79%327 ms518 ms$0.016$16.13
GLiDE v1.2 Open · 27B

GLiDE v1.2 · Fastino · decision model

Parameters: 27B dense

Kept at ≥99%: 176 answers, 176 right · 0 wrong · AUROC 0.843

Non-hallucination with “I don't know” 42.3% · answered 82.8%

Logic 55.2% · Math 69.9%

Its run record (Method) →

—64.8%63.2%–66.5%gijkl2,132 / 3,288176 right of 176 kept0 mistakes · 3,112 skipped0.84342.3%answered 83%81 ms136 ms$0.010$9.71 list$0.066$66.05estimate · RTX PRO 6000 Blackwell
Drex Max Open · 27B

Drex Max · Nace.AI · decision model

Parameters: 27B dense

Kept at ≥99%: 884 answers, 866 right · 18 wrong · AUROC 0.841

Non-hallucination with “I don't know” 5.7% · answered 97.9%

Logic 53.1% · Math 70.3%

Its run record (Method) →

—64.4%62.8%–66.0%gijkl2,118 / 3,288866 right of 884 kept18 wrong · 2,404 skipped0.8415.7%answered 98%81 ms130 ms$0.016$16.31 list$0.064$63.74estimate · RTX PRO 6000 Blackwell
Perplexity Decider 27B v1.2 API Open · 27B

Perplexity Decider 27B v1.2 API · Perplexity · decision model

Parameters: 27B dense

Kept at ≥99%: 411 answers, 409 right · 2 wrong · AUROC 0.849

Non-hallucination with “I don't know” 10.3% · answered 96.1%

Logic 53.3% · Math 69.8%

Its run record (Method) →

—64.1%62.5%–65.8%jklm2,109 / 3,288409 right of 411 kept2 wrong · 2,877 skipped0.84910.3%answered 96%230 ms439 ms$0.005$5.38
Gemini Decision 1 20261111 Closed · Efficient

Gemini Decision 1 20261111 · Google · decision model

Parameters: not disclosed by maker (closed weights)

Kept at ≥99%: 257 answers, 257 right · 0 wrong · AUROC 0.838

Non-hallucination with “I don't know” 3.0% · answered 98.9%

Logic 50.0% · Math 71.3%

Its run record (Method) →

—64.1%62.4%–65.7%hijklm2,106 / 3,288257 right of 257 kept0 mistakes · 3,031 skipped0.8383.0%answered 99%227 ms347 ms$0.027$27.07
d1.2-ultra Closed · Undisclosed

d1.2-ultra · Liquid AI · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 128 answers, 128 right · 0 wrong · AUROC 0.856

Non-hallucination with “I don't know” 90.2% · answered 48.1%

Logic 51.6% · Math 69.9%

Its run record (Method) →

—63.6%61.9%–65.2%jklm2,091 / 3,288128 right of 128 kept0 mistakes · 3,160 skipped0.85690.2%answered 48%217 ms347 ms$0.008$8.37
Perplexity Decider 27B v1.2 API · with web Open · 27B

Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

Parameters: 27B dense

Kept at ≥99%: 405 answers, 404 right · 1 wrong · AUROC 0.854

Non-hallucination with “I don't know” 25.8% · answered 90.1%

Logic 52.5% · Math 69.3%

Its run record (Method) →

with web63.6%61.9%–65.2%klm2,090 / 3,288404 right of 405 kept1 wrong · 2,883 skipped0.85425.8%answered 90%430 ms707 ms$1.025$1,025
Turion Jev 31B Open · 31B

Turion Jev 31B · Turion.AI · decision model

Parameters: 31B dense

Kept at ≥99%: 50 answers, 50 right · 0 wrong · AUROC 0.844

Non-hallucination with “I don't know” 1.9% · answered 99.3%

Logic 52.3% · Math 69.0%

Its run record (Method) →

—63.3%61.6%–64.9%jklmn2,081 / 3,28850 right of 50 kept0 mistakes · 3,238 skipped0.8441.9%answered 99%301 ms448 ms$0.020$20.01estimate · DGX Spark
SubQ Snap 1.1 Closed · Efficient

SubQ Snap 1.1 · Subquadratic · decision model

Parameters: not disclosed by maker

Shown once with SubQ Snap Preview: the same answer to every question

Kept at ≥99%: 433 answers, 430 right · 3 wrong · AUROC 0.827

Non-hallucination with “I don't know” 58.3% · answered 73.2%

Logic 52.4% · Math 68.6%

Its run record (Method) →

—63.0%61.4%–64.7%klmn2,072 / 3,288430 right of 433 kept3 wrong · 2,855 skipped0.82758.3%answered 73%382 ms391 ms$0.011$10.75
celeris-1-decision Closed · Efficient

celeris-1-decision · Celeris · decision model

Parameters: not disclosed by maker

Kept at ≥99%: No answers at this threshold · AUROC 0.829

Non-hallucination with “I don't know” 87.2% · answered 50.2%

Logic 47.3% · Math 70.0%

Its run record (Method) →

—62.2%60.6%–63.9%lmno2,046 / 3,288No answers at this threshold0.82987.2%answered 50%388 ms392 ms$0.011$11.25
celeris-1.1-decision Closed · Efficient

celeris-1.1-decision · Celeris · decision model

Parameters: not disclosed by maker

Kept at ≥99%: No answers at this threshold · AUROC 0.830

Non-hallucination with “I don't know” 86.7% · answered 50.8%

Logic 47.3% · Math 69.9%

Its run record (Method) →

—62.1%60.5%–63.8%lmnop2,043 / 3,288No answers at this threshold0.83086.7%answered 51%381 ms388 ms$0.001$1.13
KnowLine-12B-Gen1 Open · 12B

KnowLine-12B-Gen1 · PelaAI · decision model

Parameters: 12B dense

Base model: Gemma 4 12B

Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.810

Non-hallucination with “I don't know” 4.5% · answered 98.2%

Logic 50.6% · Math 66.3%

Its run record (Method) →

—60.9%59.2%–62.5%mnopq2,002 / 3,28813 right of 13 kept0 mistakes · 3,275 skipped0.8104.5%answered 98%51 ms76 ms$0.041$41.44estimate · RTX PRO 6000 Blackwell
d1.2 Closed · Undisclosed

d1.2 · Liquid AI · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 169 answers, 169 right · 0 wrong · AUROC 0.812

Non-hallucination with “I don't know” 66.9% · answered 65.1%

Logic 49.2% · Math 65.5%

Its run record (Method) →

—59.9%58.2%–61.6%nopqr1,970 / 3,288169 right of 169 kept0 mistakes · 3,119 skipped0.81266.9%answered 65%208 ms390 ms$0.004$3.98
Jev 1.14 Closed · Efficient

Jev 1.14 · TypeSafe · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 263 answers, 263 right · 0 wrong · AUROC 0.810

Non-hallucination with “I don't know” 15.4% · answered 93.3%

Logic 48.2% · Math 65.1%

Its run record (Method) →

—59.3%57.6%–61.0%opqrs1,951 / 3,288263 right of 263 kept0 mistakes · 3,025 skipped0.81015.4%answered 93%164 ms188 ms$0.021$21.27
d1.1 Closed · Efficient

d1.1 · Liquid AI · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 231 answers, 231 right · 0 wrong · AUROC 0.811

Non-hallucination with “I don't know” 86.0% · answered 46.5%

Logic 46.0% · Math 65.2%

Its run record (Method) →

—58.6%56.9%–60.3%pqrs1,928 / 3,288231 right of 231 kept0 mistakes · 3,057 skipped0.81186.0%answered 46%174 ms285 ms$0.004$3.98
Jev 1.13 Closed · Efficient

Jev 1.13 · TypeSafe · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 313 answers, 313 right · 0 wrong · AUROC 0.817

Non-hallucination with “I don't know” 10.2% · answered 95.5%

Logic 46.3% · Math 64.1%

Its run record (Method) →

—58.0%56.3%–59.7%qrst1,907 / 3,288313 right of 313 kept0 mistakes · 2,975 skipped0.81710.2%answered 96%166 ms205 ms$0.021$21.27
Adjudex 9B v5 Open · 9.0B

Adjudex 9B v5 · newsbang · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Kept at ≥99%: 253 answers, 251 right · 2 wrong · AUROC 0.802

Non-hallucination with “I don't know” 7.0% · answered 96.9%

Logic 46.4% · Math 62.1%

Its run record (Method) →

—56.7%55.0%–58.4%rstu1,865 / 3,288251 right of 253 kept2 wrong · 3,035 skipped0.8027.0%answered 97%38 ms45 ms$0.028$28.19estimate · RTX PRO 6000 Blackwell
Elephant-1 Open · 9.0B

Elephant-1 · Base Labs · decision model

Parameters: 9B dense

Kept at ≥99%: 236 answers, 235 right · 1 wrong · AUROC 0.797

Non-hallucination with “I don't know” 69.4% · answered 60.3%

Logic 46.4% · Math 61.3%

Its run record (Method) →

—56.2%54.5%–57.9%stu1,849 / 3,288235 right of 236 kept1 wrong · 3,052 skipped0.79769.4%answered 60%80 ms94 ms$0.010$9.79 list$0.058$58.27estimate · RTX PRO 6000 Blackwell
Jeffan-9B-1211 Open · 9.0B

Jeffan-9B-1211 · tattrongvu · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Kept at ≥99%: 74 answers, 74 right · 0 wrong · AUROC 0.798

Non-hallucination with “I don't know” 13.5% · answered 93.7%

Logic 48.2% · Math 59.8%

Its run record (Method) →

—55.8%54.1%–57.5%stu1,836 / 3,28874 right of 74 kept0 mistakes · 3,214 skipped0.79813.5%answered 94%39 ms53 ms$0.032$32.40estimate · RTX PRO 6000 Blackwell
KnowLine-9B-Gen2 Open · 9.0B

KnowLine-9B-Gen2 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Kept at ≥99%: No answers at this threshold · AUROC 0.786

Non-hallucination with “I don't know” 10.4% · answered 95.0%

Logic 43.9% · Math 60.1%

Its run record (Method) →

—54.6%52.9%–56.3%tuv1,794 / 3,288No answers at this threshold0.78610.4%answered 95%42 ms57 ms$0.034$34.08estimate · RTX PRO 6000 Blackwell
GLiDE 9B Open · 7.9B

GLiDE 9B · Fastino · decision model

Parameters: 7.94B dense

Kept at ≥99%: 105 answers, 105 right · 0 wrong · AUROC 0.786

Non-hallucination with “I don't know” 26.9% · answered 86.5%

Logic 47.8% · Math 57.9%

Its run record (Method) →

—54.5%52.8%–56.2%uv1,791 / 3,288105 right of 105 kept0 mistakes · 3,183 skipped0.78626.9%answered 86%177 ms222 ms$0.011$11.45estimate · DGX Spark
KnowLine-9B-Gen1 Open · 9.0B

KnowLine-9B-Gen1 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Kept at ≥99%: 153 answers, 153 right · 0 wrong · AUROC 0.782

Non-hallucination with “I don't know” 3.4% · answered 98.4%

Logic 44.3% · Math 59.8%

Its run record (Method) →

—54.5%52.8%–56.2%uv1,791 / 3,288153 right of 153 kept0 mistakes · 3,135 skipped0.7823.4%answered 98%38 ms55 ms$0.030$29.87estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-9B-Instant Open · 9.0B

StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

Parameters: 9B dense

Kept at ≥99%: 63 answers, 63 right · 0 wrong · AUROC 0.779

Non-hallucination with “I don't know” 9.6% · answered 95.4%

Logic 46.6% · Math 58.4%

Its run record (Method) →

—54.4%52.7%–56.1%uv1,788 / 3,28863 right of 63 kept0 mistakes · 3,225 skipped0.7799.6%answered 95%142 ms165 ms$0.009$8.92estimate · DGX Spark
Microsoft-Decision-1 Closed · Efficient

Microsoft-Decision-1 · Microsoft · decision model

Parameters: not disclosed by maker

Base model: Qwen3.5-9B

Kept at ≥99%: 47 answers, 47 right · 0 wrong · AUROC 0.769

Non-hallucination with “I don't know” 11.4% · answered 94.5%

Logic 44.4% · Math 59.4%

Its run record (Method) →

—54.3%52.6%–56.0%uvw1,784 / 3,28847 right of 47 kept0 mistakes · 3,241 skipped0.76911.4%answered 94%312 ms360 ms$0.009$9.07
Dexy-Decision-9B-V2 Open · 9.0B

Dexy-Decision-9B-V2 · Patrick-18 · decision model

Parameters: 9B dense

Base model: vllm-sr/d3-flash

Kept at ≥99%: 266 answers, 263 right · 3 wrong · AUROC 0.795

Non-hallucination with “I don't know” 6.1% · answered 97.1%

Logic 45.3% · Math 58.8%

Its run record (Method) →

—54.2%52.5%–55.9%uvw1,782 / 3,288263 right of 266 kept3 wrong · 3,022 skipped0.7956.1%answered 97%46 ms51 ms$0.033$32.61estimate · RTX PRO 6000 Blackwell
Drex 2.0 Open · 35B MoE · 3.0B active

Drex 2.0 · Nace.AI · decision model

Parameters: 35B MoE · 3B active

Kept at ≥99%: 207 answers, 207 right · 0 wrong · AUROC 0.789

Non-hallucination with “I don't know” 28.1% · answered 85.3%

Logic 41.9% · Math 59.0%

Its run record (Method) →

—53.1%51.4%–54.8%uvwx1,747 / 3,288207 right of 207 kept0 mistakes · 3,081 skipped0.78928.1%answered 85%339 ms472 ms$0.012$12.17
vera-medium-omni Open · 4.2B

vera-medium-omni · scar-ai · decision model

Parameters: 4.2B dense

Base model: Qwen3.5-4B

Kept at ≥99%: 39 answers, 39 right · 0 wrong · AUROC 0.777

Non-hallucination with “I don't know” 7.9% · answered 96.1%

Logic 44.1% · Math 56.8%

Its run record (Method) →

—52.5%50.8%–54.2%vwxy1,725 / 3,28839 right of 39 kept0 mistakes · 3,249 skipped0.7777.9%answered 96%31 ms36 ms$0.024$24.19estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-4B-Instant Open · 4.0B

StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

Parameters: 4B dense

Kept at ≥99%: 117 answers, 117 right · 0 wrong · AUROC 0.763

Non-hallucination with “I don't know” 14.4% · answered 92.6%

Logic 45.9% · Math 55.8%

Its run record (Method) →

—52.4%50.7%–54.1%vwxy1,724 / 3,288117 right of 117 kept0 mistakes · 3,171 skipped0.76314.4%answered 93%68 ms80 ms$0.004$4.28estimate · DGX Spark
Perplexity Decider Flash v1.3 Open · 4.0B

Perplexity Decider Flash v1.3 · Perplexity · decision model

Parameters: 4B dense

Kept at ≥99%: 131 answers, 130 right · 1 wrong · AUROC 0.782

Non-hallucination with “I don't know” 15.0% · answered 92.4%

Logic 44.7% · Math 55.9%

Its run record (Method) →

—52.1%50.4%–53.8%vwxy1,713 / 3,288130 right of 131 kept1 wrong · 3,157 skipped0.78215.0%answered 92%29 ms35 ms$0.024$23.77estimate · RTX PRO 6000 Blackwell
Cerno 9B v1.2 Open · 9.0B

Cerno 9B v1.2 · Apertix AI · decision model

Parameters: 9B dense

Kept at ≥99%: 281 answers, 270 right · 11 wrong · AUROC 0.776

Non-hallucination with “I don't know” 3.1% · answered 98.5%

Logic 43.3% · Math 56.0%

Its run record (Method) →

—51.7%50.0%–53.4%vwxy1,699 / 3,288270 right of 281 kept11 wrong · 3,007 skipped0.7763.1%answered 99%163 ms240 ms$0.011$10.82estimate · DGX Spark
Valen-Decision-1.5-9B Open · 9.0B

Valen-Decision-1.5-9B · Valen-Team · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Kept at ≥99%: 167 answers, 165 right · 2 wrong · AUROC 0.765

Non-hallucination with “I don't know” 7.1% · answered 96.4%

Logic 44.4% · Math 55.3%

Its run record (Method) →

—51.6%49.9%–53.3%vwxy1,696 / 3,288165 right of 167 kept2 wrong · 3,121 skipped0.7657.1%answered 96%59 ms65 ms$0.041$41.44estimate · RTX PRO 6000 Blackwell
KnowLine 4B Gen5.5 Open · 4.0B

KnowLine 4B Gen5.5 · PelaAI · decision model

Parameters: 4B dense

Kept at ≥99%: 72 answers, 71 right · 1 wrong · AUROC 0.752

Non-hallucination with “I don't know” 4.4% · answered 97.8%

Logic 42.3% · Math 56.0%

Its run record (Method) →

—51.3%49.6%–53.0%vwxyz1,687 / 3,28871 right of 72 kept1 wrong · 3,216 skipped0.7524.4%answered 98%76 ms104 ms$0.005$5.02estimate · DGX Spark
Perplexity Decider Flash v1.2 Open · 4.0B

Perplexity Decider Flash v1.2 · Perplexity · decision model

Parameters: 4B dense

Kept at ≥99%: 190 answers, 185 right · 5 wrong · AUROC 0.769

Non-hallucination with “I don't know” 18.9% · answered 90.0%

Logic 43.1% · Math 55.2%

Its run record (Method) →

—51.1%49.4%–52.8%vwxyz1,680 / 3,288185 right of 190 kept5 wrong · 3,098 skipped0.76918.9%answered 90%41 ms51 ms$0.003$2.72 list$0.032$31.55estimate · RTX PRO 6000 Blackwell
Mercury Decide Closed · Efficient

Mercury Decide · Inception · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 372 answers, 356 right · 16 wrong · AUROC 0.777

Non-hallucination with “I don't know” 10.1% · answered 94.9%

Logic 45.1% · Math 53.5%

Its run record (Method) →

—50.6%48.9%–52.3%wxyzA1,664 / 3,288356 right of 372 kept16 wrong · 2,916 skipped0.77710.1%answered 95%293 ms349 ms$0.005$5.46
d1 Closed · Efficient

d1 · Liquid AI · decision model

Parameters: not disclosed by maker

Kept at ≥99%: 208 answers, 207 right · 1 wrong · AUROC 0.757

Non-hallucination with “I don't know” 6.4% · answered 96.7%

Logic 40.8% · Math 55.6%

Its run record (Method) →

—50.5%48.8%–52.3%wxyzA1,662 / 3,288207 right of 208 kept1 wrong · 3,080 skipped0.7576.4%answered 97%185 ms292 ms$0.004$3.98
Open-Jev-27B-v1.1 Open · 27B

Open-Jev-27B-v1.1 · Zefan Cai · decision model

Parameters: 27B dense

Base model: Qwen3.8-27B + adapter

Kept at ≥99%: No answers at this threshold · AUROC 0.759

Non-hallucination with “I don't know” 14.5% · answered 92.4%

Logic 42.6% · Math 54.6%

Its run record (Method) →

—50.5%48.7%–52.2%xyzA1,659 / 3,288No answers at this threshold0.75914.5%answered 92%250 ms482 ms$0.212$212estimate · RTX PRO 6000 Blackwell
OneJev-27B Open · 27B

OneJev-27B · OmniJev · decision model

Parameters: 27B dense

Kept at ≥99%: 30 answers, 30 right · 0 wrong · AUROC 0.770

Non-hallucination with “I don't know” 1.6% · answered 99.2%

Logic 40.6% · Math 53.8%

Its run record (Method) →

—49.3%47.6%–51.0%yzAB1,620 / 3,28830 right of 30 kept0 mistakes · 3,258 skipped0.7701.6%answered 99%80 ms134 ms$0.069$69.42estimate · RTX PRO 6000 Blackwell
Clef Open · 27B

Clef · Cloudflare · decision model

Parameters: 27B dense

Kept at ≥99%: 18 answers, 18 right · 0 wrong · AUROC 0.747

Non-hallucination with “I don't know” 2.4% · answered 98.8%

Logic 40.8% · Math 51.1%

Its run record (Method) →

—47.6%45.9%–49.3%zABC1,564 / 3,28818 right of 18 kept0 mistakes · 3,270 skipped0.7472.4%answered 99%185 ms216 ms$0.081$81.46 list$0.135$135estimate · RTX PRO 6000 Blackwell
Verdin-4B-v1.1 Open · 4.0B

Verdin-4B-v1.1 · victorbennett · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Kept at ≥99%: 165 answers, 161 right · 4 wrong · AUROC 0.747

Non-hallucination with “I don't know” 8.9% · answered 95.2%

Logic 39.7% · Math 51.5%

Its run record (Method) →

—47.5%45.8%–49.2%ABC1,561 / 3,288161 right of 165 kept4 wrong · 3,123 skipped0.7478.9%answered 95%46 ms52 ms$0.033$33.45estimate · RTX PRO 6000 Blackwell
Chinese Decision Pointer 4B Open · 4.0B

Chinese Decision Pointer 4B · quincyqiang · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Kept at ≥99%: 194 answers, 188 right · 6 wrong · AUROC 0.743

Non-hallucination with “I don't know” 7.8% · answered 95.8%

Logic 40.4% · Math 50.4%

Its run record (Method) →

—47.0%45.3%–48.7%ABC1,545 / 3,288188 right of 194 kept6 wrong · 3,094 skipped0.7437.8%answered 96%30 ms42 ms$0.025$25.03estimate · RTX PRO 6000 Blackwell
Clef-Flash Open · 9.0B

Clef-Flash · Cloudflare · decision model

Parameters: 9B dense

Kept at ≥99%: No answers at this threshold · AUROC 0.707

Non-hallucination with “I don't know” 6.9% · answered 96.2%

Logic 38.9% · Math 49.8%

Its run record (Method) →

—46.1%44.4%–47.8%BCD1,515 / 3,288No answers at this threshold0.7076.9%answered 96%103 ms131 ms$0.013$12.90 list$0.075$75.10estimate · RTX PRO 6000 Blackwell
Winnow-12B Open · 12B

Winnow-12B · EldanRing · decision model

Parameters: 12B dense

Kept at ≥99%: 53 answers, 52 right · 1 wrong · AUROC 0.737

Non-hallucination with “I don't know” 17.1% · answered 89.8%

Logic 39.7% · Math 46.9%

Its run record (Method) →

—44.4%42.7%–46.1%CD1,461 / 3,28852 right of 53 kept1 wrong · 3,235 skipped0.73717.1%answered 90%55 ms72 ms$0.043$42.91estimate · RTX PRO 6000 Blackwell
Cygnet Open · 12B

Cygnet · Blockbrain Labs · decision model

Parameters: 11.95B dense

Base model: Gemma 4 12B IT

Kept at ≥99%: No answers at this threshold · AUROC 0.729

Non-hallucination with “I don't know” 7.3% · answered 95.7%

Logic 39.3% · Math 44.3%

Its run record (Method) →

—42.6%40.9%–44.3%D1,401 / 3,288No answers at this threshold0.7297.3%answered 96%38 ms44 ms$0.029$29.34 list$0.029$28.61estimate · RTX PRO 6000 Blackwell
Metask-Jev-4B Open · 4.5B

Metask-Jev-4B · Metask Lab · decision model

Parameters: 4.54B dense

Kept at ≥99%: No answers at this threshold · AUROC 0.659

Non-hallucination with “I don't know” 2.0% · answered 98.7%

Logic 32.1% · Math 39.2%

Its run record (Method) →

—36.7%35.1%–38.4%E1,208 / 3,288No answers at this threshold0.6592.0%answered 99%117 ms146 ms$0.086$85.83estimate · RTX PRO 6000 Blackwell
StartLux-Decision-v1.1-2B-Instant Open · 2.0B

StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

Parameters: 2B dense

Kept at ≥99%: 4 answers, 4 right · 0 wrong · AUROC 0.675

Non-hallucination with “I don't know” 16.4% · answered 88.9%

Logic 30.8% · Math 38.7%

Its run record (Method) →

—35.9%34.3%–37.6%E1,182 / 3,2884 right of 4 kept0 mistakes · 3,284 skipped0.67516.4%answered 89%36 ms42 ms$0.002$2.36estimate · DGX Spark
GLiDE 2B Open · 1.9B

GLiDE 2B · Fastino · decision model

Parameters: 1.88B dense

Kept at ≥99%: 30 answers, 29 right · 1 wrong · AUROC 0.637

Non-hallucination with “I don't know” 23.1% · answered 84.1%

Logic 32.3% · Math 36.8%

Its run record (Method) →

—35.2%33.6%–36.9%E1,158 / 3,28829 right of 30 kept1 wrong · 3,258 skipped0.63723.1%answered 84%28 ms37 ms$0.002$1.94estimate · DGX Spark
d1-2B Open · 1.9B

d1-2B · Liquid AI · decision model

Parameters: 1.92B dense

Base model: LFM3-VL-2B

Kept at ≥99%: 7 answers, 7 right · 0 wrong · AUROC 0.648

Non-hallucination with “I don't know” 82.5% · answered 29.6%

Logic 30.7% · Math 37.1%

Its run record (Method) →

—34.9%33.3%–36.5%EF1,147 / 3,2887 right of 7 kept0 mistakes · 3,281 skipped0.64882.5%answered 30%17 ms21 ms$0.014$14.30estimate · RTX PRO 6000 Blackwell
KnowLine-2B-Gen1 Open · 2.0B

KnowLine-2B-Gen1 · PelaAI · decision model

Parameters: 2B dense

Base model: Qwen3.5-2B

Kept at ≥99%: 16 answers, 16 right · 0 wrong · AUROC 0.626

Non-hallucination with “I don't know” 6.8% · answered 95.3%

Logic 31.7% · Math 35.3%

Its run record (Method) →

—34.1%32.5%–35.7%EF1,120 / 3,28816 right of 16 kept0 mistakes · 3,272 skipped0.6266.8%answered 95%51 ms63 ms$0.003$3.40estimate · DGX Spark
GLiDE 0.8B Open · 0.8B

GLiDE 0.8B · Fastino · decision model

Parameters: 0.75B dense

Kept at ≥99%: 13 answers, 13 right · 0 wrong · AUROC 0.602

Non-hallucination with “I don't know” 22.7% · answered 83.2%

Logic 29.2% · Math 32.1%

Its run record (Method) →

—31.1%29.5%–32.7%FG1,022 / 3,28813 right of 13 kept0 mistakes · 3,275 skipped0.60222.7%answered 83%20 ms25 ms$0.001$1.38estimate · DGX Spark
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B

StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Kept at ≥99%: No answers at this threshold · AUROC 0.605

Non-hallucination with “I don't know” 14.9% · answered 88.9%

Logic 24.7% · Math 29.7%

Its run record (Method) →

—28.0%26.5%–29.5%GH920 / 3,288No answers at this threshold0.60514.9%answered 89%24 ms29 ms$0.002$1.62estimate · DGX Spark
OneJev1.6-0.8B Open · 0.8B

OneJev1.6-0.8B · OmniJev · decision model

Parameters: 0.8B dense

Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.576

Non-hallucination with “I don't know” 2.0% · answered 98.5%

Logic 27.0% · Math 28.2%

Its run record (Method) →

—27.8%26.3%–29.4%GH915 / 3,2882 right of 2 kept0 mistakes · 3,286 skipped0.5762.0%answered 99%15 ms17 ms$0.001$1.11estimate · DGX Spark
KnowLine-0.8B-Gen1 Open · 0.8B

KnowLine-0.8B-Gen1 · PelaAI · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Kept at ≥99%: 2 answers, 2 right · 0 wrong · AUROC 0.590

Non-hallucination with “I don't know” 0.6% · answered 99.5%

Logic 26.7% · Math 28.2%

Its run record (Method) →

—27.7%26.2%–29.2%GH910 / 3,2882 right of 2 kept0 mistakes · 3,286 skipped0.5900.6%answered 100%26 ms35 ms$0.002$1.80estimate · DGX Spark
Strands Decider 2B Open · 2.0B

Strands Decider 2B · Strands Agents · decision model

Parameters: 2B dense

Kept at ≥99%: No answers at this threshold · AUROC 0.573

Non-hallucination with “I don't know” 5.0% · answered 96.3%

Logic 22.4% · Math 28.7%

Its run record (Method) →

—26.5%25.0%–28.1%HI872 / 3,288No answers at this threshold0.5735.0%answered 96%35 ms42 ms$0.027$26.72estimate · RTX PRO 6000 Blackwell
GLiClass v4 Edge Open · 0.4B

GLiClass v4 Edge · decision model

Parameters: 0.4B dense

Base model: DeBERTa-v3-large

Kept at ≥99%: No answers at this threshold · AUROC 0.511

Non-hallucination with “I don't know” 15.6% · answered 87.3%

Logic 23.6% · Math 22.7%

Its run record (Method) →

—23.0%21.6%–24.4%IJ755 / 3,288No answers at this threshold0.51115.6%answered 87%12 ms23 ms$0.001$1.01estimate · DGX Spark
GLiDE 0.4B Open · 0.4B

GLiDE 0.4B · Fastino · decision model

Parameters: 0.40B dense

Kept at ≥99%: No answers at this threshold · AUROC 0.520

Non-hallucination with “I don't know” 73.9% · answered 31.7%

Logic 23.2% · Math 20.6%

Its run record (Method) →

—21.5%20.1%–22.9%J706 / 3,288No answers at this threshold0.52073.9%answered 32%11 ms14 ms$0.001$0.83estimate · DGX Spark

Tie groups and “not measured”

estimate · RTX PRO 6000 Blackwell / DGX Spark = run on our own hardware; its cost is an estimate, explained on hover, focus or tap of the amount: the machine's wall-clock time on the run, first to last answer while it was running (pauses, estimated from gaps of more than 10 minutes between answers, left out and listed), × $2.49/h per NVIDIA RTX PRO 6000 Blackwell (96 GB) (Runpod's price for the card) or × $0.213/h per NVIDIA DGX Spark (GB10) (its purchase over three years plus electricity; see Method), each run charged in full even when runs shared the machine, so at most; sorting and the cost chart use the estimate; list = maker's list price × our token counts; unmarked = provider's price × usage the API reported.