Logic · Cost

Cost on Logic

1,125 questions, asked in English. How to read this page · Method

Cost

Dollars per 1,000 questionsper 1M questions (log scale), the run's cost over the questions it answered; “estimate”: a run on our own hardware, its GPU time × the machine's hourly rate (hover, focus or tap a name in the tables for how it was counted); the cost basis of each is in the table below · lower is better

  1. GLiDE 0.4B

    GLiDE 0.4B · Fastino · decision model

    Parameters: 0.40B dense

    Cost $0.001$0.95estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 20.6%

    Its run record (Method) →

    $0.001$0.95estimate · DGX Spark
  2. OneJev1.6-0.8B

    OneJev1.6-0.8B · OmniJev · decision model

    Parameters: 0.8B dense

    Cost $0.001$1.16estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 28.2%

    Its run record (Method) →

    $0.001$1.16estimate · DGX Spark
  3. GLiClass v4 Edge

    GLiClass v4 Edge · decision model

    Parameters: 0.4B dense

    Base model: DeBERTa-v3-large

    Cost $0.001$1.31estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 22.7%

    Its run record (Method) →

    $0.001$1.31estimate · DGX Spark
  4. celeris-1.1-decision

    celeris-1.1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Cost $0.002$1.54 per 1,000 questionsper 1M questions

    Math 69.9%

    Its run record (Method) →

    $0.002$1.54
  5. GLiDE 0.8B

    GLiDE 0.8B · Fastino · decision model

    Parameters: 0.75B dense

    Cost $0.002$1.58estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 32.1%

    Its run record (Method) →

    $0.002$1.58estimate · DGX Spark
  6. StartLux-Decision-v1.1-0.8B-Instant

    StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Cost $0.002$1.79estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 29.7%

    Its run record (Method) →

    $0.002$1.79estimate · DGX Spark
  7. KnowLine-0.8B-Gen1

    KnowLine-0.8B-Gen1 · PelaAI · decision model

    Parameters: 0.8B dense

    Base model: Qwen3.5-0.8B

    Cost $0.002$2.00estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 28.2%

    Its run record (Method) →

    $0.002$2.00estimate · DGX Spark
  8. GLiDE 2B

    GLiDE 2B · Fastino · decision model

    Parameters: 1.88B dense

    Cost $0.002$2.26estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 36.8%

    Its run record (Method) →

    $0.002$2.26estimate · DGX Spark
  9. StartLux-Decision-v1.1-2B-Instant

    StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

    Parameters: 2B dense

    Cost $0.003$2.52estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 38.7%

    Its run record (Method) →

    $0.003$2.52estimate · DGX Spark
  10. Perplexity Decider Flash v1.2

    Perplexity Decider Flash v1.2 · Perplexity · decision model

    Parameters: 4B dense

    Cost $0.004$3.76 list$0.034$34.43estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 55.2%

    Its run record (Method) →

    $0.004$3.76 list
  11. KnowLine-2B-Gen1

    KnowLine-2B-Gen1 · PelaAI · decision model

    Parameters: 2B dense

    Base model: Qwen3.5-2B

    Cost $0.004$3.78estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 35.3%

    Its run record (Method) →

    $0.004$3.78estimate · DGX Spark
  12. StartLux-Decision-v1.1-4B-Instant

    StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

    Parameters: 4B dense

    Cost $0.005$4.62estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 55.8%

    Its run record (Method) →

    $0.005$4.62estimate · DGX Spark
  13. KnowLine 4B Gen5.5

    KnowLine 4B Gen5.5 · PelaAI · decision model

    Parameters: 4B dense

    Cost $0.006$5.89estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 56.0%

    Its run record (Method) →

    $0.006$5.89estimate · DGX Spark
  14. d1.2

    d1.2 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Cost $0.006$6.02 per 1,000 questionsper 1M questions

    Math 65.5%

    Its run record (Method) →

    $0.006$6.02
  15. d1.1

    d1.1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Cost $0.006$6.02 per 1,000 questionsper 1M questions

    Math 65.2%

    Its run record (Method) →

    $0.006$6.02
  16. d1

    d1 · Liquid AI · decision model

    Parameters: not disclosed by maker

    Cost $0.006$6.02 per 1,000 questionsper 1M questions

    Math 55.6%

    Its run record (Method) →

    $0.006$6.02
  17. Perplexity Decider 27B v1.2 API

    Perplexity Decider 27B v1.2 API · Perplexity · decision model

    Parameters: 27B dense

    Cost $0.007$7.46 per 1,000 questionsper 1M questions

    Math 69.8%

    Its run record (Method) →

    $0.007$7.46
  18. Mercury Decide

    Mercury Decide · Inception · decision model

    Parameters: not disclosed by maker

    Cost $0.008$7.52 per 1,000 questionsper 1M questions

    Math 53.5%

    Its run record (Method) →

    $0.008$7.52
  19. StartLux-Decision-v1.1-9B-Instant

    StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

    Parameters: 9B dense

    Cost $0.010$10.04estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 58.4%

    Its run record (Method) →

    $0.010$10.04estimate · DGX Spark
  20. d1-ultra

    d1-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

    Cost $0.013$12.64 per 1,000 questionsper 1M questions

    Math 74.1%

    Its run record (Method) →

    $0.013$12.64
  21. d1.2-ultra

    d1.2-ultra · Liquid AI · decision model

    Parameters: not disclosed by maker

    Cost $0.013$12.64 per 1,000 questionsper 1M questions

    Math 69.9%

    Its run record (Method) →

    $0.013$12.64
  22. GLiDE 9B

    GLiDE 9B · Fastino · decision model

    Parameters: 7.94B dense

    Cost $0.013$13.29estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 57.9%

    Its run record (Method) →

    $0.013$13.29estimate · DGX Spark
  23. Cerno 9B v1.2

    Cerno 9B v1.2 · Apertix AI · decision model

    Parameters: 9B dense

    Cost $0.013$13.35estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 56.0%

    Its run record (Method) →

    $0.013$13.35estimate · DGX Spark
  24. Microsoft-Decision-1

    Microsoft-Decision-1 · Microsoft · decision model

    Parameters: not disclosed by maker

    Base model: Qwen3.5-9B

    Cost $0.013$13.42 per 1,000 questionsper 1M questions

    Math 59.4%

    Its run record (Method) →

    $0.013$13.42
  25. Elephant-1

    Elephant-1 · Base Labs · decision model

    Parameters: 9B dense

    Cost $0.013$13.44 list$0.058$58.41estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 61.3%

    Its run record (Method) →

    $0.013$13.44 list
  26. GLiDE v1.2

    GLiDE v1.2 · Fastino · decision model

    Parameters: 27B dense

    Cost $0.014$13.88 list$0.082$81.77estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 69.9%

    Its run record (Method) →

    $0.014$13.88 list
  27. d1-2B

    d1-2B · Liquid AI · decision model

    Parameters: 1.92B dense

    Base model: LFM3-VL-2B

    Cost $0.015$14.76estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 37.1%

    Its run record (Method) →

    $0.015$14.76estimate · RTX PRO 6000 Blackwell
  28. SubQ Snap 1.1

    SubQ Snap 1.1 · Subquadratic · decision model

    Parameters: not disclosed by maker

    Shown once with SubQ Snap Preview: the same answer to every question

    Cost $0.015$14.92 per 1,000 questionsper 1M questions

    Math 68.6%

    Its run record (Method) →

    $0.015$14.92
  29. celeris-1-decision

    celeris-1-decision · Celeris · decision model

    Parameters: not disclosed by maker

    Cost $0.015$15.40 per 1,000 questionsper 1M questions

    Math 70.0%

    Its run record (Method) →

    $0.015$15.40
  30. Clef-Flash

    Clef-Flash · Cloudflare · decision model

    Parameters: 9B dense

    Cost $0.017$16.83 list$0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 49.8%

    Its run record (Method) →

    $0.017$16.83 list
  31. Drex 2.0

    Drex 2.0 · Nace.AI · decision model

    Parameters: 35B MoE · 3B active

    Cost $0.018$18.41 per 1,000 questionsper 1M questions

    Math 59.0%

    Its run record (Method) →

    $0.018$18.41
  32. Drex Max v1.1

    Drex Max v1.1 · Nace.AI · decision model

    Parameters: not disclosed by maker

    Cost $0.022$22.37 per 1,000 questionsper 1M questions

    Math 70.1%

    Its run record (Method) →

    $0.022$22.37
  33. Drex Max

    Drex Max · Nace.AI · decision model

    Parameters: 27B dense

    Cost $0.023$22.55 list$0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 70.3%

    Its run record (Method) →

    $0.023$22.55 list
  34. Turion Jev 31B

    Turion Jev 31B · Turion.AI · decision model

    Parameters: 31B dense

    Cost $0.025$24.91estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 69.0%

    Its run record (Method) →

    $0.025$24.91estimate · DGX Spark
  35. Jev 1.14

    Jev 1.14 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Cost $0.026$25.64 per 1,000 questionsper 1M questions

    Math 65.1%

    Its run record (Method) →

    $0.026$25.64
  36. Jev 1.13

    Jev 1.13 · TypeSafe · decision model

    Parameters: not disclosed by maker

    Cost $0.026$25.64 per 1,000 questionsper 1M questions

    Math 64.1%

    Its run record (Method) →

    $0.026$25.64
  37. vera-medium-omni

    vera-medium-omni · scar-ai · decision model

    Parameters: 4.2B dense

    Base model: Qwen3.5-4B

    Cost $0.026$25.82estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 56.8%

    Its run record (Method) →

    $0.026$25.82estimate · RTX PRO 6000 Blackwell
  38. Perplexity Decider Flash v1.3

    Perplexity Decider Flash v1.3 · Perplexity · decision model

    Parameters: 4B dense

    Cost $0.026$26.44estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 55.9%

    Its run record (Method) →

    $0.026$26.44estimate · RTX PRO 6000 Blackwell
  39. Strands Decider 2B

    Strands Decider 2B · Strands Agents · decision model

    Parameters: 2B dense

    Cost $0.028$27.67estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 28.7%

    Its run record (Method) →

    $0.028$27.67estimate · RTX PRO 6000 Blackwell
  40. Chinese Decision Pointer 4B

    Chinese Decision Pointer 4B · quincyqiang · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Cost $0.030$29.51estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 50.4%

    Its run record (Method) →

    $0.030$29.51estimate · RTX PRO 6000 Blackwell
  41. Adjudex 9B v5

    Adjudex 9B v5 · newsbang · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Cost $0.031$31.36estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 62.1%

    Its run record (Method) →

    $0.031$31.36estimate · RTX PRO 6000 Blackwell
  42. GLiDE 27B

    GLiDE 27B · Fastino · decision model

    Parameters: 27B dense

    Cost $0.033$33.16estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 72.0%

    Its run record (Method) →

    $0.033$33.16estimate · DGX Spark
  43. Verdin-4B-v1.1

    Verdin-4B-v1.1 · victorbennett · decision model

    Parameters: 4B dense

    Base model: Qwen3.5-4B

    Cost $0.033$33.20estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 51.5%

    Its run record (Method) →

    $0.033$33.20estimate · RTX PRO 6000 Blackwell
  44. Dexy-Decision-9B-V2

    Dexy-Decision-9B-V2 · Patrick-18 · decision model

    Parameters: 9B dense

    Base model: vllm-sr/d3-flash

    Cost $0.034$33.81estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 58.8%

    Its run record (Method) →

    $0.034$33.81estimate · RTX PRO 6000 Blackwell
  45. KnowLine-9B-Gen1

    KnowLine-9B-Gen1 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Cost $0.036$36.27estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 59.8%

    Its run record (Method) →

    $0.036$36.27estimate · RTX PRO 6000 Blackwell
  46. Gemini Decision 1 20261111

    Gemini Decision 1 20261111 · Google · decision model

    Parameters: not disclosed by maker (closed weights)

    Cost $0.037$36.77 per 1,000 questionsper 1M questions

    Math 71.3%

    Its run record (Method) →

    $0.037$36.77
  47. Mammoth-1

    Mammoth-1 · Base Labs · decision model

    Parameters: 27B dense

    Cost $0.038$38.39 list$0.151$151estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 74.0%

    Its run record (Method) →

    $0.038$38.39 list
  48. Jeffan-9B-1211

    Jeffan-9B-1211 · tattrongvu · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Cost $0.039$39.35estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 59.8%

    Its run record (Method) →

    $0.039$39.35estimate · RTX PRO 6000 Blackwell
  49. Cygnet

    Cygnet · Blockbrain Labs · decision model

    Parameters: 11.95B dense

    Base model: Gemma 4 12B IT

    Cost $0.040$39.71 list$0.031$30.74estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 44.3%

    Its run record (Method) →

    $0.040$39.71 list
  50. KnowLine-9B-Gen2

    KnowLine-9B-Gen2 · PelaAI · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Cost $0.040$39.96estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 60.1%

    Its run record (Method) →

    $0.040$39.96estimate · RTX PRO 6000 Blackwell
  51. Valen-Decision-1.5-9B

    Valen-Decision-1.5-9B · Valen-Team · decision model

    Parameters: 9B dense

    Base model: Qwen3.5-9B

    Cost $0.042$42.42estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 55.3%

    Its run record (Method) →

    $0.042$42.42estimate · RTX PRO 6000 Blackwell
  52. KnowLine-12B-Gen1

    KnowLine-12B-Gen1 · PelaAI · decision model

    Parameters: 12B dense

    Base model: Gemma 4 12B

    Cost $0.052$51.64estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 66.3%

    Its run record (Method) →

    $0.052$51.64estimate · RTX PRO 6000 Blackwell
  53. Winnow-12B

    Winnow-12B · EldanRing · decision model

    Parameters: 12B dense

    Cost $0.052$51.64estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 46.9%

    Its run record (Method) →

    $0.052$51.64estimate · RTX PRO 6000 Blackwell
  54. GLiDE API

    GLiDE API · Fastino · decision model

    Parameters: not disclosed by maker

    Cost $0.052$52.03 per 1,000 questionsper 1M questions

    Math 70.8%

    Its run record (Method) →

    $0.052$52.03
  55. d3

    d3 · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Cost $0.057$57.18estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 70.4%

    Its run record (Method) →

    $0.057$57.18estimate · RTX PRO 6000 Blackwell
  56. KnowLine-31B-Gen1.5

    KnowLine-31B-Gen1.5 · PelaAI · decision model

    Parameters: 31B dense

    Cost $0.061$61.43estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 77.4%

    Its run record (Method) →

    $0.061$61.43estimate · DGX Spark
  57. Sieve 31B v3

    Sieve 31B v3 · Sthānika AI · decision model

    Parameters: 31B dense

    Cost $0.063$62.95estimate · DGX Spark per 1,000 questionsper 1M questions

    Math 77.1%

    Its run record (Method) →

    $0.063$62.95estimate · DGX Spark
  58. Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell

    Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

    Parameters: 27B dense

    Cost $0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 72.5%

    Its run record (Method) →

    $0.081$81.16estimate · RTX PRO 6000 Blackwell
  59. OneJev-27B

    OneJev-27B · OmniJev · decision model

    Parameters: 27B dense

    Cost $0.086$86.07estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 53.8%

    Its run record (Method) →

    $0.086$86.07estimate · RTX PRO 6000 Blackwell
  60. Metask-Jev-4B

    Metask-Jev-4B · Metask Lab · decision model

    Parameters: 4.54B dense

    Cost $0.091$90.99estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 39.2%

    Its run record (Method) →

    $0.091$90.99estimate · RTX PRO 6000 Blackwell
  61. Clef

    Clef · Cloudflare · decision model

    Parameters: 27B dense

    Cost $0.106$106 list$0.141$141estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 51.1%

    Its run record (Method) →

    $0.106$106 list
  62. d3-ultra

    d3-ultra · vLLM Semantic Router · decision model

    Parameters: 26.09B dense

    Cost $0.109$109estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 71.5%

    Its run record (Method) →

    $0.109$109estimate · RTX PRO 6000 Blackwell
  63. KnowLine-31B-Gen2

    KnowLine-31B-Gen2 · PelaAI · decision model

    Parameters: 31B dense

    Base model: Gemma 4 31B

    Cost $0.112$112estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 80.3%

    Its run record (Method) →

    $0.112$112estimate · RTX PRO 6000 Blackwell
  64. Karpo Decision 31B

    Karpo Decision 31B · MachinePulse · decision model

    Parameters: 31B dense

    Cost $0.128$128estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 81.6%

    Its run record (Method) →

    $0.128$128estimate · RTX PRO 6000 Blackwell
  65. Copernicus-31B

    Copernicus-31B · Poindexter Labs · decision model

    Parameters: 31B dense

    Cost $0.136$136estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 77.3%

    Its run record (Method) →

    $0.136$136estimate · RTX PRO 6000 Blackwell
  66. REAX 1.3

    REAX 1.3 · REAX · decision model

    Parameters: 57.36B dense

    Cost $0.160$160estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 78.0%

    Its run record (Method) →

    $0.160$160estimate · RTX PRO 6000 Blackwell
  67. Logits Sigma-1 Duo

    Logits Sigma-1 Duo · Logits · decision model

    Parameters: 57.36B dense

    Cost $0.211$211estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 75.2%

    Its run record (Method) →

    $0.211$211estimate · RTX PRO 6000 Blackwell
  68. Open-Jev-27B-v1.1

    Open-Jev-27B-v1.1 · Zefan Cai · decision model

    Parameters: 27B dense

    Base model: Qwen3.8-27B + adapter

    Cost $0.294$294estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

    Math 54.6%

    Its run record (Method) →

    $0.294$294estimate · RTX PRO 6000 Blackwell
  69. Perplexity Decider 27B v1.2 API · with web

    Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

    Parameters: 27B dense

    Cost $1.030$1,030 per 1,000 questionsper 1M questions

    Math 69.3%

    Its run record (Method) →

    $1.030$1,030

Fastino OmniJev Other Celeris StartLux PelaAI Perplexity Liquid AI Inception Apertix AI Microsoft Base Labs Subquadratic Cloudflare Nace.AI Turion.AI TypeSafe scar-ai Strands Agents quincyqiang newsbang victorbennett Patrick-18 Google tattrongvu Blockbrain Labs Valen-Team EldanRing vLLM Semantic Router Sthānika AI Metask Lab MachinePulse Poindexter Labs REAX Logits Zefan Cai

Accuracy across cost

Each setup's accuracy against its cost per 1,000 questions (log scale); the dotted line joins the Pareto front: no other setup is both cheaper and more accurate; shaded: cheaper and more accurate than the median setup

$0.0001$0.001$0.01$0.1$1$1010%25%40%55%70%Cost, $ per 1,000 questions (log scale)AccuracyLower on this axis and more accurate than the median setupPareto front: no other setup is both lower on this axis and more accurate

GLiDE 0.4B: 23.2% at $0.001 per 1,000 questions ($0.95 per 1M) (estimate)

OneJev1.6-0.8B: 27.0% at $0.001 per 1,000 questions ($1.16 per 1M) (estimate)

GLiClass v4 Edge: 23.6% at $0.001 per 1,000 questions ($1.31 per 1M) (estimate)

celeris-1.1-decision: 47.3% at $0.002 per 1,000 questions ($1.54 per 1M)

GLiDE 0.8B: 29.2% at $0.002 per 1,000 questions ($1.58 per 1M) (estimate)

StartLux-Decision-v1.1-0.8B-Instant: 24.7% at $0.002 per 1,000 questions ($1.79 per 1M) (estimate)

KnowLine-0.8B-Gen1: 26.7% at $0.002 per 1,000 questions ($2.00 per 1M) (estimate)

GLiDE 2B: 32.3% at $0.002 per 1,000 questions ($2.26 per 1M) (estimate)

StartLux-Decision-v1.1-2B-Instant: 30.8% at $0.003 per 1,000 questions ($2.52 per 1M) (estimate)

Perplexity Decider Flash v1.2: 43.1% at $0.004 per 1,000 questions ($3.76 per 1M)

KnowLine-2B-Gen1: 31.7% at $0.004 per 1,000 questions ($3.78 per 1M) (estimate)

StartLux-Decision-v1.1-4B-Instant: 45.9% at $0.005 per 1,000 questions ($4.62 per 1M) (estimate)

KnowLine 4B Gen5.5: 42.3% at $0.006 per 1,000 questions ($5.89 per 1M) (estimate)

d1.2: 49.2% at $0.006 per 1,000 questions ($6.02 per 1M)

d1.1: 46.0% at $0.006 per 1,000 questions ($6.02 per 1M)

d1: 40.8% at $0.006 per 1,000 questions ($6.02 per 1M)

Perplexity Decider 27B v1.2 (API): 53.3% at $0.007 per 1,000 questions ($7.46 per 1M)

Mercury Decide: 45.1% at $0.008 per 1,000 questions ($7.52 per 1M)

StartLux-Decision-v1.1-9B-Instant: 46.6% at $0.010 per 1,000 questions ($10.04 per 1M) (estimate)

d1-ultra: 54.9% at $0.013 per 1,000 questions ($12.64 per 1M)

d1.2-ultra: 51.6% at $0.013 per 1,000 questions ($12.64 per 1M)

GLiDE 9B: 47.8% at $0.013 per 1,000 questions ($13.29 per 1M) (estimate)

Cerno 9B v1.2: 43.3% at $0.013 per 1,000 questions ($13.35 per 1M) (estimate)

Microsoft-Decision-1: 44.4% at $0.013 per 1,000 questions ($13.42 per 1M)

Elephant-1: 46.4% at $0.013 per 1,000 questions ($13.44 per 1M)

GLiDE (v1.2): 55.2% at $0.014 per 1,000 questions ($13.88 per 1M)

d1-2B: 30.7% at $0.015 per 1,000 questions ($14.76 per 1M) (estimate)

SubQ Snap 1.1: 52.4% at $0.015 per 1,000 questions ($14.92 per 1M)

celeris-1-decision: 47.3% at $0.015 per 1,000 questions ($15.40 per 1M)

Clef-Flash: 38.9% at $0.017 per 1,000 questions ($16.83 per 1M)

Drex 2.0: 41.9% at $0.018 per 1,000 questions ($18.41 per 1M)

Drex Max v1.1: 54.8% at $0.022 per 1,000 questions ($22.37 per 1M)

Drex Max: 53.1% at $0.023 per 1,000 questions ($22.55 per 1M)

Turion Jev 31B: 52.3% at $0.025 per 1,000 questions ($24.91 per 1M) (estimate)

Jev 1.14: 48.2% at $0.026 per 1,000 questions ($25.64 per 1M)

Jev 1.13: 46.3% at $0.026 per 1,000 questions ($25.64 per 1M)

vera-medium-omni: 44.1% at $0.026 per 1,000 questions ($25.82 per 1M) (estimate)

Perplexity Decider Flash v1.3: 44.7% at $0.026 per 1,000 questions ($26.44 per 1M) (estimate)

Strands Decider 2B: 22.4% at $0.028 per 1,000 questions ($27.67 per 1M) (estimate)

Chinese Decision Pointer 4B: 40.4% at $0.030 per 1,000 questions ($29.51 per 1M) (estimate)

Adjudex 9B v5: 46.4% at $0.031 per 1,000 questions ($31.36 per 1M) (estimate)

GLiDE 27B: 58.4% at $0.033 per 1,000 questions ($33.16 per 1M) (estimate)

Verdin-4B-v1.1: 39.7% at $0.033 per 1,000 questions ($33.20 per 1M) (estimate)

Dexy-Decision-9B-V2: 45.3% at $0.034 per 1,000 questions ($33.81 per 1M) (estimate)

KnowLine-9B-Gen1: 44.3% at $0.036 per 1,000 questions ($36.27 per 1M) (estimate)

Gemini Decision 1 (20261111): 50.0% at $0.037 per 1,000 questions ($36.77 per 1M)

Mammoth-1: 54.5% at $0.038 per 1,000 questions ($38.39 per 1M)

Jeffan-9B-1211: 48.2% at $0.039 per 1,000 questions ($39.35 per 1M) (estimate)

Cygnet: 39.3% at $0.040 per 1,000 questions ($39.71 per 1M)

KnowLine-9B-Gen2: 43.9% at $0.040 per 1,000 questions ($39.96 per 1M) (estimate)

Valen-Decision-1.5-9B: 44.4% at $0.042 per 1,000 questions ($42.42 per 1M) (estimate)

KnowLine-12B-Gen1: 50.6% at $0.052 per 1,000 questions ($51.64 per 1M) (estimate)

Winnow-12B: 39.7% at $0.052 per 1,000 questions ($51.64 per 1M) (estimate)

GLiDE (API): 54.5% at $0.052 per 1,000 questions ($52.03 per 1M)

d3: 54.5% at $0.057 per 1,000 questions ($57.18 per 1M) (estimate)

KnowLine-31B-Gen1.5: 59.0% at $0.061 per 1,000 questions ($61.43 per 1M) (estimate)

Sieve 31B v3: 57.9% at $0.063 per 1,000 questions ($62.95 per 1M) (estimate)

Perplexity Decider 27B v1.3 (NVIDIA RTX PRO 6000 Blackwell): 54.8% at $0.081 per 1,000 questions ($81.16 per 1M) (estimate)

OneJev-27B: 40.6% at $0.086 per 1,000 questions ($86.07 per 1M) (estimate)

Metask-Jev-4B: 32.1% at $0.091 per 1,000 questions ($90.99 per 1M) (estimate)

Clef: 40.8% at $0.106 per 1,000 questions ($106 per 1M)

d3-ultra: 54.6% at $0.109 per 1,000 questions ($109 per 1M) (estimate)

KnowLine-31B-Gen2: 58.9% at $0.112 per 1,000 questions ($112 per 1M) (estimate)

Karpo Decision 31B: 60.7% at $0.128 per 1,000 questions ($128 per 1M) (estimate)

Copernicus-31B: 58.7% at $0.136 per 1,000 questions ($136 per 1M) (estimate)

REAX 1.3: 59.3% at $0.160 per 1,000 questions ($160 per 1M) (estimate)

Logits Sigma-1 Duo: 57.8% at $0.211 per 1,000 questions ($211 per 1M) (estimate)

Open-Jev-27B-v1.1: 42.6% at $0.294 per 1,000 questions ($294 per 1M) (estimate)

Perplexity Decider 27B v1.2 (API · with web): 52.5% at $1.030 per 1,000 questions ($1,030 per 1M)

Fastino OmniJev Other Celeris StartLux PelaAI Perplexity Liquid AI Inception Apertix AI Microsoft Base Labs Subquadratic Cloudflare Nace.AI Turion.AI TypeSafe scar-ai Strands Agents quincyqiang newsbang victorbennett Patrick-18 Google tattrongvu Blockbrain Labs Valen-Team EldanRing vLLM Semantic Router Sthānika AI Metask Lab MachinePulse Poindexter Labs REAX Logits Zefan Cai

Cost and its basis

SetupWebCostper 1,000 or 1M questions (switch)Cost$ per 1M questionsRun total$ for the questions answeredOn our hardwareGPU-time cost beside a list price (switch)Basisprovider price × usage, list price, GPU time, …
GLiDE 0.4B Pareto Open · 0.4B—$0.001$0.95estimate · DGX Spark$0.95 estimate$0.001064 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
OneJev1.6-0.8B Pareto Open · 0.8B—$0.001$1.16estimate · DGX Spark$1.16 estimate$0.001301 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
GLiClass v4 Edge Open · 0.4B—$0.001$1.31estimate · DGX Spark$1.31 estimate$0.001478 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
celeris-1.1-decision Pareto Closed · Efficient—$0.002$1.54$1.54$0.001733—provider price × reported usage
GLiDE 0.8B Open · 0.8B—$0.002$1.58estimate · DGX Spark$1.58 estimate$0.001773 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B—$0.002$1.79estimate · DGX Spark$1.79 estimate$0.00201 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
KnowLine-0.8B-Gen1 Open · 0.8B—$0.002$2.00estimate · DGX Spark$2.00 estimate$0.002246 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
GLiDE 2B Open · 1.9B—$0.002$2.26estimate · DGX Spark$2.26 estimate$0.002542 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
StartLux-Decision-v1.1-2B-Instant Open · 2.0B—$0.003$2.52estimate · DGX Spark$2.52 estimate$0.002838 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Perplexity Decider Flash v1.2 Open · 4.0B—$0.004$3.76 list$3.76$0.004229$0.034$34.43estimate · RTX PRO 6000 Blackwellmaker's list price
KnowLine-2B-Gen1 Open · 2.0B—$0.004$3.78estimate · DGX Spark$3.78 estimate$0.004256 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
StartLux-Decision-v1.1-4B-Instant Open · 4.0B—$0.005$4.62estimate · DGX Spark$4.62 estimate$0.005202 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
KnowLine 4B Gen5.5 Open · 4.0B—$0.006$5.89estimate · DGX Spark$5.89 estimate$0.006621 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
d1.2 Pareto Closed · Undisclosed—$0.006$6.02$6.02$0.006773—provider price × reported usage
d1.1 Closed · Efficient—$0.006$6.02$6.02$0.006773—provider price × reported usage
d1 Closed · Efficient—$0.006$6.02$6.02$0.006773—provider price × reported usage
Perplexity Decider 27B v1.2 Pareto API Open · 27B—$0.007$7.46$7.46$0.00839—provider price × reported usage
Mercury Decide Closed · Efficient—$0.008$7.52$7.52$0.008459—provider price × reported usage
StartLux-Decision-v1.1-9B-Instant Open · 9.0B—$0.010$10.04estimate · DGX Spark$10.04 estimate$0.01129 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
d1-ultra Pareto Closed · Efficient—$0.013$12.64$12.64$0.01422—provider price × reported usage
d1.2-ultra Closed · Undisclosed—$0.013$12.64$12.64$0.01422—provider price × reported usage
GLiDE 9B Open · 7.9B—$0.013$13.29estimate · DGX Spark$13.29 estimate$0.01496 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Cerno 9B v1.2 Open · 9.0B—$0.013$13.35estimate · DGX Spark$13.35 estimate$0.01502 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Microsoft-Decision-1 Closed · Efficient—$0.013$13.42$13.42$0.0151—provider price × reported usage
Elephant-1 Open · 9.0B—$0.013$13.44 list$13.44$0.01512$0.058$58.41estimate · RTX PRO 6000 Blackwellmaker's list price
GLiDE Pareto v1.2 Open · 27B—$0.014$13.88 list$13.88$0.01561$0.082$81.77estimate · RTX PRO 6000 Blackwellmaker's list price
d1-2B Open · 1.9B—$0.015$14.76estimate · RTX PRO 6000 Blackwell$14.76 estimate$0.0166 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
SubQ Snap 1.1 Closed · Efficient—$0.015$14.92$14.92$0.01678—provider price × reported usage
celeris-1-decision Closed · Efficient—$0.015$15.40$15.40$0.01733—provider price × reported usage
Clef-Flash Open · 9.0B—$0.017$16.83 list$16.83$0.01894$0.081$81.16estimate · RTX PRO 6000 Blackwellmaker's list price
Drex 2.0 Open · 35B MoE · 3.0B active—$0.018$18.41$18.41$0.02072—provider price × reported usage
Drex Max v1.1 Closed · Efficient (provisional)—$0.022$22.37$22.37$0.02517—provider price × reported usage
Drex Max Open · 27B—$0.023$22.55 list$22.55$0.02537$0.081$81.16estimate · RTX PRO 6000 Blackwellmaker's list price
Turion Jev 31B Open · 31B—$0.025$24.91estimate · DGX Spark$24.91 estimate$0.02802 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Jev 1.14 Closed · Efficient—$0.026$25.64$25.64$0.02885—provider price × reported usage
Jev 1.13 Closed · Efficient—$0.026$25.64$25.64$0.02885—provider price × reported usage
vera-medium-omni Open · 4.2B—$0.026$25.82estimate · RTX PRO 6000 Blackwell$25.82 estimate$0.02905 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Perplexity Decider Flash v1.3 Open · 4.0B—$0.026$26.44estimate · RTX PRO 6000 Blackwell$26.44 estimate$0.02974 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Strands Decider 2B Open · 2.0B—$0.028$27.67estimate · RTX PRO 6000 Blackwell$27.67 estimate$0.03113 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Chinese Decision Pointer 4B Open · 4.0B—$0.030$29.51estimate · RTX PRO 6000 Blackwell$29.51 estimate$0.0332 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Adjudex 9B v5 Open · 9.0B—$0.031$31.36estimate · RTX PRO 6000 Blackwell$31.36 estimate$0.03528 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
GLiDE 27B Pareto Open · 27B—$0.033$33.16estimate · DGX Spark$33.16 estimate$0.0373 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Verdin-4B-v1.1 Open · 4.0B—$0.033$33.20estimate · RTX PRO 6000 Blackwell$33.20 estimate$0.03735 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Dexy-Decision-9B-V2 Open · 9.0B—$0.034$33.81estimate · RTX PRO 6000 Blackwell$33.81 estimate$0.03804 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
KnowLine-9B-Gen1 Open · 9.0B—$0.036$36.27estimate · RTX PRO 6000 Blackwell$36.27 estimate$0.04081 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Gemini Decision 1 20261111 Closed · Efficient—$0.037$36.77$36.77$0.04137—provider price × reported usage
Mammoth-1 Open · 27B—$0.038$38.39 list$38.39$0.04319$0.151$151estimate · RTX PRO 6000 Blackwellmaker's list price
Jeffan-9B-1211 Open · 9.0B—$0.039$39.35estimate · RTX PRO 6000 Blackwell$39.35 estimate$0.04427 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Cygnet Open · 12B—$0.040$39.71 list$39.71$0.04468$0.031$30.74estimate · RTX PRO 6000 Blackwellpublic host's list price (same weights)
KnowLine-9B-Gen2 Open · 9.0B—$0.040$39.96estimate · RTX PRO 6000 Blackwell$39.96 estimate$0.04496 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Valen-Decision-1.5-9B Open · 9.0B—$0.042$42.42estimate · RTX PRO 6000 Blackwell$42.42 estimate$0.04773 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
KnowLine-12B-Gen1 Open · 12B—$0.052$51.64estimate · RTX PRO 6000 Blackwell$51.64 estimate$0.0581 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Winnow-12B Open · 12B—$0.052$51.64estimate · RTX PRO 6000 Blackwell$51.64 estimate$0.0581 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
GLiDE API Closed · Efficient—$0.052$52.03$52.03$0.05854—provider price × reported usage
d3 Open · 26B—$0.057$57.18estimate · RTX PRO 6000 Blackwell$57.18 estimate$0.06433 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
KnowLine-31B-Gen1.5 Pareto Open · 31B—$0.061$61.43estimate · DGX Spark$61.43 estimate$0.06911 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Sieve 31B v3 Open · 31B—$0.063$62.95estimate · DGX Spark$62.95 estimate$0.07082 estimate—estimate: NVIDIA DGX Spark (GB10) time while the run was running, first to last answer × $0.213/h
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B—$0.081$81.16estimate · RTX PRO 6000 Blackwell$81.16 estimate$0.0913 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
OneJev-27B Open · 27B—$0.086$86.07estimate · RTX PRO 6000 Blackwell$86.07 estimate$0.09683 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Metask-Jev-4B Open · 4.5B—$0.091$90.99estimate · RTX PRO 6000 Blackwell$90.99 estimate$0.1024 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Clef Open · 27B—$0.106$106 list$106.31$0.1196$0.141$141estimate · RTX PRO 6000 Blackwellmaker's list price
d3-ultra Open · 26B—$0.109$109estimate · RTX PRO 6000 Blackwell$109.44 estimate$0.1231 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
KnowLine-31B-Gen2 Open · 31B—$0.112$112estimate · RTX PRO 6000 Blackwell$111.90 estimate$0.1259 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Karpo Decision 31B Pareto Open · 31B—$0.128$128estimate · RTX PRO 6000 Blackwell$128.50 estimate$0.1446 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Copernicus-31B Open · 31B—$0.136$136estimate · RTX PRO 6000 Blackwell$135.87 estimate$0.1529 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
REAX 1.3 Open · 57B—$0.160$160estimate · RTX PRO 6000 Blackwell$160.47 estimate$0.1805 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Logits Sigma-1 Duo Open · 57B—$0.211$211estimate · RTX PRO 6000 Blackwell$211.50 estimate$0.2379 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Open-Jev-27B-v1.1 Open · 27B—$0.294$294estimate · RTX PRO 6000 Blackwell$294.50 estimate$0.3313 estimate—estimate: NVIDIA RTX PRO 6000 Blackwell (96 GB) time while the run was running, first to last answer × $2.49/h
Perplexity Decider 27B v1.2 API · with web Open · 27Bwith web$1.030$1,030$1,029.58$1.158—provider price × reported usage

estimate · RTX PRO 6000 Blackwell / DGX Spark = run on our own hardware; its cost is an estimate, explained on hover, focus or tap of the amount: the machine's wall-clock time on the run, first to last answer while it was running (pauses, estimated from gaps of more than 10 minutes between answers, left out and listed), × $2.49/h per NVIDIA RTX PRO 6000 Blackwell (96 GB) (Runpod's price for the card) or × $0.213/h per NVIDIA DGX Spark (GB10) (its purchase over three years plus electricity; see Method), each run charged in full even when runs shared the machine, so at most; sorting and the cost chart use the estimate; list = maker's list price × our token counts; unmarked = provider's price × usage the API reported.

SubQ Snap Preview and SubQ Snap 1.1 returned the same answer to every question (and the same probabilities on 1,125 of 1,125); shown once.

Perplexity Decider 27B v1.2 (API) and Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell): two setups of the same model, one on an NVIDIA RTX PRO 6000 Blackwell (96 GB) and one through Perplexity's API; not verified to be identical weights or settings. Its row is the API setup on every test; Perplexity Decider 27B v1.2 (NVIDIA RTX PRO 6000 Blackwell) is under the row's other settings and All setups.

Every setup, every measure

SetupWebAccuracy% of N (N ≤ 1,125) · Wilson 95%Tie groupHolm · McNemarRight / NquestionsKept at ≥99%right / wrongAUROCright vs wrongNon-hallucinationof answers not right, % “I don't know” · higher is betterMedian latencymsp90ms, nearest rankCost$ per 1,000 qper 1M q
Karpo Decision 31B Open · 31B

Karpo Decision 31B · MachinePulse · decision model

Parameters: 31B dense

Cost $0.128$128estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 81.6%

Its run record (Method) →

—60.7%57.8%–63.5%ab683 / 1,125169 right of 172 kept3 wrong · 953 skipped0.8166.6%answered 97%173 ms211 ms$0.128$128estimate · RTX PRO 6000 Blackwell
REAX 1.3 Open · 57B

REAX 1.3 · REAX · decision model

Parameters: 57.36B dense

Cost $0.160$160estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 78.0%

Its run record (Method) →

—59.3%56.4%–62.1%ac667 / 1,12551 right of 51 kept0 mistakes · 1,074 skipped0.8165.3%answered 98%215 ms278 ms$0.160$160estimate · RTX PRO 6000 Blackwell
KnowLine-31B-Gen1.5 Open · 31B

KnowLine-31B-Gen1.5 · PelaAI · decision model

Parameters: 31B dense

Cost $0.061$61.43estimate · DGX Spark per 1,000 questionsper 1M questions

Math 77.4%

Its run record (Method) →

—59.0%56.1%–61.9%abcd664 / 1,12589 right of 89 kept0 mistakes · 1,036 skipped0.8040.4%answered 100%983 ms1,279 ms$0.061$61.43estimate · DGX Spark
KnowLine-31B-Gen2 Open · 31B

KnowLine-31B-Gen2 · PelaAI · decision model

Parameters: 31B dense

Base model: Gemma 4 31B

Cost $0.112$112estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 80.3%

Its run record (Method) →

—58.9%56.0%–61.8%abcd663 / 1,12554 right of 54 kept0 mistakes · 1,071 skipped0.8250.0%answered 100%151 ms204 ms$0.112$112estimate · RTX PRO 6000 Blackwell
Copernicus-31B Open · 31B

Copernicus-31B · Poindexter Labs · decision model

Parameters: 31B dense

Cost $0.136$136estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 77.3%

Its run record (Method) →

—58.7%55.8%–61.5%abcd660 / 1,12566 right of 66 kept0 mistakes · 1,059 skipped0.8011.9%answered 99%185 ms255 ms$0.136$136estimate · RTX PRO 6000 Blackwell
GLiDE 27B Open · 27B

GLiDE 27B · Fastino · decision model

Parameters: 27B dense

Cost $0.033$33.16estimate · DGX Spark per 1,000 questionsper 1M questions

Math 72.0%

Its run record (Method) →

—58.4%55.5%–61.2%abcde657 / 1,12574 right of 75 kept1 wrong · 1,050 skipped0.82244.3%answered 79%544 ms655 ms$0.033$33.16estimate · DGX Spark
Sieve 31B v3 Open · 31B

Sieve 31B v3 · Sthānika AI · decision model

Parameters: 31B dense

Cost $0.063$62.95estimate · DGX Spark per 1,000 questionsper 1M questions

Math 77.1%

Its run record (Method) →

—57.9%55.0%–60.7%abcdf651 / 1,12579 right of 81 kept2 wrong · 1,044 skipped0.7975.5%answered 98%1,050 ms1,335 ms$0.063$62.95estimate · DGX Spark
Logits Sigma-1 Duo Open · 57B

Logits Sigma-1 Duo · Logits · decision model

Parameters: 57.36B dense

Cost $0.211$211estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 75.2%

Its run record (Method) →

—57.8%54.9%–60.6%abcdefg650 / 1,1258 right of 8 kept0 mistakes · 1,117 skipped0.7967.1%answered 97%285 ms399 ms$0.211$211estimate · RTX PRO 6000 Blackwell
GLiDE v1.2 Open · 27B

GLiDE v1.2 · Fastino · decision model

Parameters: 27B dense

Cost $0.014$13.88 list$0.082$81.77estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 69.9%

Its run record (Method) →

—55.2%52.3%–58.1%abcdefgh621 / 1,12545 right of 45 kept0 mistakes · 1,080 skipped0.79350.2%answered 73%111 ms140 ms$0.014$13.88 list$0.082$81.77estimate · RTX PRO 6000 Blackwell
d1-ultra Closed · Efficient

d1-ultra · Liquid AI · decision model

Parameters: not disclosed by maker (built on a larger open-weight model, not named with a count)

Cost $0.013$12.64 per 1,000 questionsper 1M questions

Math 74.1%

Its run record (Method) →

—54.9%52.0%–57.8%abcdefgh618 / 1,12520 right of 20 kept0 mistakes · 1,105 skipped0.78391.0%answered 35%182 ms425 ms$0.013$12.64
Drex Max v1.1 Closed · Efficient (provisional)

Drex Max v1.1 · Nace.AI · decision model

Parameters: not disclosed by maker

Cost $0.022$22.37 per 1,000 questionsper 1M questions

Math 70.1%

Its run record (Method) →

—54.8%51.8%–57.6%abcdefghi616 / 1,12589 right of 90 kept1 wrong · 1,035 skipped0.79354.1%answered 69%329 ms1,540 ms$0.022$22.37
Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell Open · 27B

Perplexity Decider 27B v1.3 NVIDIA RTX PRO 6000 Blackwell · Perplexity · decision model

Parameters: 27B dense

Cost $0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 72.5%

Its run record (Method) →

—54.8%51.8%–57.6%abcdefgh616 / 1,12562 right of 62 kept0 mistakes · 1,063 skipped0.80318.1%answered 91%108 ms131 ms$0.081$81.16estimate · RTX PRO 6000 Blackwell
d3-ultra Open · 26B

d3-ultra · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Cost $0.109$109estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 71.5%

Its run record (Method) →

—54.6%51.7%–57.5%bdefghij614 / 1,12528 right of 28 kept0 mistakes · 1,097 skipped0.77810.1%answered 95%156 ms185 ms$0.109$109estimate · RTX PRO 6000 Blackwell
GLiDE API Closed · Efficient

GLiDE API · Fastino · decision model

Parameters: not disclosed by maker

Cost $0.052$52.03 per 1,000 questionsper 1M questions

Math 70.8%

Its run record (Method) →

—54.5%51.6%–57.4%cdefghi613 / 1,12552 right of 52 kept0 mistakes · 1,073 skipped0.81460.0%answered 67%271 ms291 ms$0.052$52.03
Mammoth-1 Open · 27B

Mammoth-1 · Base Labs · decision model

Parameters: 27B dense

Cost $0.038$38.39 list$0.151$151estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 74.0%

Its run record (Method) →

—54.5%51.6%–57.4%cdefghij613 / 1,125106 right of 108 kept2 wrong · 1,017 skipped0.79572.3%answered 58%221 ms244 ms$0.038$38.39 list$0.151$151estimate · RTX PRO 6000 Blackwell
d3 Open · 26B

d3 · vLLM Semantic Router · decision model

Parameters: 26.09B dense

Cost $0.057$57.18estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 70.4%

Its run record (Method) →

—54.5%51.6%–57.4%cdefgh613 / 1,12554 right of 54 kept0 mistakes · 1,071 skipped0.80614.8%answered 93%76 ms98 ms$0.057$57.18estimate · RTX PRO 6000 Blackwell
Perplexity Decider 27B v1.2 API Open · 27B

Perplexity Decider 27B v1.2 API · Perplexity · decision model

Parameters: 27B dense

Cost $0.007$7.46 per 1,000 questionsper 1M questions

Math 69.8%

Its run record (Method) →

—53.3%50.4%–56.2%defghijk600 / 1,12578 right of 80 kept2 wrong · 1,045 skipped0.79814.4%answered 93%238 ms552 ms$0.007$7.46
Drex Max Open · 27B

Drex Max · Nace.AI · decision model

Parameters: 27B dense

Cost $0.023$22.55 list$0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 70.3%

Its run record (Method) →

—53.1%50.1%–56.0%defghijk597 / 1,125147 right of 155 kept8 wrong · 970 skipped0.7867.3%answered 97%106 ms143 ms$0.023$22.55 list$0.081$81.16estimate · RTX PRO 6000 Blackwell
Perplexity Decider 27B v1.2 API · with web Open · 27B

Perplexity Decider 27B v1.2 API · with web · Perplexity · decision model

Parameters: 27B dense

Cost $1.030$1,030 per 1,000 questionsper 1M questions

Math 69.3%

Its run record (Method) →

with web52.5%49.6%–55.4%fghijkl591 / 1,12578 right of 79 kept1 wrong · 1,046 skipped0.80037.7%answered 80%448 ms827 ms$1.030$1,030
SubQ Snap 1.1 Closed · Efficient

SubQ Snap 1.1 · Subquadratic · decision model

Parameters: not disclosed by maker

Shown once with SubQ Snap Preview: the same answer to every question

Cost $0.015$14.92 per 1,000 questionsper 1M questions

Math 68.6%

Its run record (Method) →

—52.4%49.4%–55.3%fghijklm589 / 1,12570 right of 72 kept2 wrong · 1,053 skipped0.78765.7%answered 61%384 ms393 ms$0.015$14.92
Turion Jev 31B Open · 31B

Turion Jev 31B · Turion.AI · decision model

Parameters: 31B dense

Cost $0.025$24.91estimate · DGX Spark per 1,000 questionsper 1M questions

Math 69.0%

Its run record (Method) →

—52.3%49.3%–55.2%eghijklmn588 / 1,1257 right of 7 kept0 mistakes · 1,118 skipped0.7821.5%answered 99%385 ms533 ms$0.025$24.91estimate · DGX Spark
d1.2-ultra Closed · Undisclosed

d1.2-ultra · Liquid AI · decision model

Parameters: not disclosed by maker

Cost $0.013$12.64 per 1,000 questionsper 1M questions

Math 69.9%

Its run record (Method) →

—51.6%48.6%–54.5%hijklmno580 / 1,12513 right of 13 kept0 mistakes · 1,112 skipped0.80094.5%answered 28%220 ms341 ms$0.013$12.64
KnowLine-12B-Gen1 Open · 12B

KnowLine-12B-Gen1 · PelaAI · decision model

Parameters: 12B dense

Base model: Gemma 4 12B

Cost $0.052$51.64estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 66.3%

Its run record (Method) →

—50.6%47.7%–53.5%hijklmnop569 / 1,1256 right of 6 kept0 mistakes · 1,119 skipped0.7748.8%answered 95%68 ms88 ms$0.052$51.64estimate · RTX PRO 6000 Blackwell
Gemini Decision 1 20261111 Closed · Efficient

Gemini Decision 1 20261111 · Google · decision model

Parameters: not disclosed by maker (closed weights)

Cost $0.037$36.77 per 1,000 questionsper 1M questions

Math 71.3%

Its run record (Method) →

—50.0%47.1%–53.0%hijklmnopq563 / 1,12543 right of 43 kept0 mistakes · 1,082 skipped0.7682.0%answered 99%228 ms344 ms$0.037$36.77
d1.2 Closed · Undisclosed

d1.2 · Liquid AI · decision model

Parameters: not disclosed by maker

Cost $0.006$6.02 per 1,000 questionsper 1M questions

Math 65.5%

Its run record (Method) →

—49.2%46.2%–52.1%hijklmnopqr553 / 1,12528 right of 28 kept0 mistakes · 1,097 skipped0.74278.8%answered 43%222 ms390 ms$0.006$6.02
Jeffan-9B-1211 Open · 9.0B

Jeffan-9B-1211 · tattrongvu · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Cost $0.039$39.35estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 59.8%

Its run record (Method) →

—48.2%45.3%–51.1%jklmnopqrs542 / 1,12510 right of 10 kept0 mistakes · 1,115 skipped0.75323.4%answered 87%52 ms66 ms$0.039$39.35estimate · RTX PRO 6000 Blackwell
Jev 1.14 Closed · Efficient

Jev 1.14 · TypeSafe · decision model

Parameters: not disclosed by maker

Cost $0.026$25.64 per 1,000 questionsper 1M questions

Math 65.1%

Its run record (Method) →

—48.2%45.3%–51.1%ijklmnopqrs542 / 1,12561 right of 61 kept0 mistakes · 1,064 skipped0.75024.5%answered 86%166 ms193 ms$0.026$25.64
GLiDE 9B Open · 7.9B

GLiDE 9B · Fastino · decision model

Parameters: 7.94B dense

Cost $0.013$13.29estimate · DGX Spark per 1,000 questionsper 1M questions

Math 57.9%

Its run record (Method) →

—47.8%44.9%–50.7%klmnopqrs538 / 1,12532 right of 32 kept0 mistakes · 1,093 skipped0.74930.4%answered 82%208 ms251 ms$0.013$13.29estimate · DGX Spark
celeris-1-decision Closed · Efficient

celeris-1-decision · Celeris · decision model

Parameters: not disclosed by maker

Cost $0.015$15.40 per 1,000 questionsper 1M questions

Math 70.0%

Its run record (Method) →

—47.3%44.4%–50.2%klmnopqrstu532 / 1,125No answers at this threshold0.73592.3%answered 28%390 ms394 ms$0.015$15.40
celeris-1.1-decision Closed · Efficient

celeris-1.1-decision · Celeris · decision model

Parameters: not disclosed by maker

Cost $0.002$1.54 per 1,000 questionsper 1M questions

Math 69.9%

Its run record (Method) →

—47.3%44.4%–50.2%klmnopqrst532 / 1,125No answers at this threshold0.73391.0%answered 29%383 ms390 ms$0.002$1.54
StartLux-Decision-v1.1-9B-Instant Open · 9.0B

StartLux-Decision-v1.1-9B-Instant · StartLux · decision model

Parameters: 9B dense

Cost $0.010$10.04estimate · DGX Spark per 1,000 questionsper 1M questions

Math 58.4%

Its run record (Method) →

—46.6%43.7%–49.5%lmnopqrstuv524 / 1,12514 right of 14 kept0 mistakes · 1,111 skipped0.76217.4%answered 90%160 ms175 ms$0.010$10.04estimate · DGX Spark
Adjudex 9B v5 Open · 9.0B

Adjudex 9B v5 · newsbang · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Cost $0.031$31.36estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 62.1%

Its run record (Method) →

—46.4%43.5%–49.3%lmnopqrstuv522 / 1,12554 right of 55 kept1 wrong · 1,070 skipped0.77112.2%answered 93%41 ms46 ms$0.031$31.36estimate · RTX PRO 6000 Blackwell
Elephant-1 Open · 9.0B

Elephant-1 · Base Labs · decision model

Parameters: 9B dense

Cost $0.013$13.44 list$0.058$58.41estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 61.3%

Its run record (Method) →

—46.4%43.5%–49.3%lmnopqrstuv522 / 1,12553 right of 53 kept0 mistakes · 1,072 skipped0.76875.6%answered 47%79 ms98 ms$0.013$13.44 list$0.058$58.41estimate · RTX PRO 6000 Blackwell
Jev 1.13 Closed · Efficient

Jev 1.13 · TypeSafe · decision model

Parameters: not disclosed by maker

Cost $0.026$25.64 per 1,000 questionsper 1M questions

Math 64.1%

Its run record (Method) →

—46.3%43.4%–49.2%lmnopqrstuv521 / 1,12565 right of 65 kept0 mistakes · 1,060 skipped0.76415.8%answered 91%167 ms203 ms$0.026$25.64
d1.1 Closed · Efficient

d1.1 · Liquid AI · decision model

Parameters: not disclosed by maker

Cost $0.006$6.02 per 1,000 questionsper 1M questions

Math 65.2%

Its run record (Method) →

—46.0%43.2%–49.0%mnopqrstuvw518 / 1,12548 right of 48 kept0 mistakes · 1,077 skipped0.74890.6%answered 28%176 ms272 ms$0.006$6.02
StartLux-Decision-v1.1-4B-Instant Open · 4.0B

StartLux-Decision-v1.1-4B-Instant · StartLux · decision model

Parameters: 4B dense

Cost $0.005$4.62estimate · DGX Spark per 1,000 questionsper 1M questions

Math 55.8%

Its run record (Method) →

—45.9%43.0%–48.8%nopqrstuvx516 / 1,12521 right of 21 kept0 mistakes · 1,104 skipped0.72016.0%answered 91%73 ms84 ms$0.005$4.62estimate · DGX Spark
Dexy-Decision-9B-V2 Open · 9.0B

Dexy-Decision-9B-V2 · Patrick-18 · decision model

Parameters: 9B dense

Base model: vllm-sr/d3-flash

Cost $0.034$33.81estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 58.8%

Its run record (Method) →

—45.3%42.4%–48.3%opqrstuvwxy510 / 1,12556 right of 56 kept0 mistakes · 1,069 skipped0.75912.4%answered 93%47 ms53 ms$0.034$33.81estimate · RTX PRO 6000 Blackwell
Mercury Decide Closed · Efficient

Mercury Decide · Inception · decision model

Parameters: not disclosed by maker

Cost $0.008$7.52 per 1,000 questionsper 1M questions

Math 53.5%

Its run record (Method) →

—45.1%42.2%–48.0%pqrstuvwxy507 / 1,12584 right of 91 kept7 wrong · 1,034 skipped0.74620.5%answered 88%301 ms360 ms$0.008$7.52
Perplexity Decider Flash v1.3 Open · 4.0B

Perplexity Decider Flash v1.3 · Perplexity · decision model

Parameters: 4B dense

Cost $0.026$26.44estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 55.9%

Its run record (Method) →

—44.7%41.8%–47.6%pqrstuvwxy503 / 1,12517 right of 17 kept0 mistakes · 1,108 skipped0.75724.4%answered 85%33 ms41 ms$0.026$26.44estimate · RTX PRO 6000 Blackwell
Microsoft-Decision-1 Closed · Efficient

Microsoft-Decision-1 · Microsoft · decision model

Parameters: not disclosed by maker

Base model: Qwen3.5-9B

Cost $0.013$13.42 per 1,000 questionsper 1M questions

Math 59.4%

Its run record (Method) →

—44.4%41.6%–47.4%pqrstuvwxy500 / 1,12520 right of 20 kept0 mistakes · 1,105 skipped0.71219.8%answered 88%315 ms362 ms$0.013$13.42
Valen-Decision-1.5-9B Open · 9.0B

Valen-Decision-1.5-9B · Valen-Team · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Cost $0.042$42.42estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 55.3%

Its run record (Method) →

—44.4%41.5%–47.3%pqrstuvwxy499 / 1,12535 right of 37 kept2 wrong · 1,088 skipped0.70113.6%answered 92%60 ms67 ms$0.042$42.42estimate · RTX PRO 6000 Blackwell
KnowLine-9B-Gen1 Open · 9.0B

KnowLine-9B-Gen1 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Cost $0.036$36.27estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 59.8%

Its run record (Method) →

—44.3%41.4%–47.2%pqrstuvwxy498 / 1,12530 right of 30 kept0 mistakes · 1,095 skipped0.7256.7%answered 96%50 ms61 ms$0.036$36.27estimate · RTX PRO 6000 Blackwell
vera-medium-omni Open · 4.2B

vera-medium-omni · scar-ai · decision model

Parameters: 4.2B dense

Base model: Qwen3.5-4B

Cost $0.026$25.82estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 56.8%

Its run record (Method) →

—44.1%41.2%–47.0%qrstuvwxy496 / 1,1256 right of 6 kept0 mistakes · 1,119 skipped0.73913.6%answered 92%32 ms37 ms$0.026$25.82estimate · RTX PRO 6000 Blackwell
KnowLine-9B-Gen2 Open · 9.0B

KnowLine-9B-Gen2 · PelaAI · decision model

Parameters: 9B dense

Base model: Qwen3.5-9B

Cost $0.040$39.96estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 60.1%

Its run record (Method) →

—43.9%41.0%–46.8%qrstuvwxy494 / 1,125No answers at this threshold0.73019.5%answered 88%52 ms65 ms$0.040$39.96estimate · RTX PRO 6000 Blackwell
Cerno 9B v1.2 Open · 9.0B

Cerno 9B v1.2 · Apertix AI · decision model

Parameters: 9B dense

Cost $0.013$13.35estimate · DGX Spark per 1,000 questionsper 1M questions

Math 56.0%

Its run record (Method) →

—43.3%40.4%–46.2%rstuvwxy487 / 1,12526 right of 27 kept1 wrong · 1,098 skipped0.7526.0%answered 97%209 ms269 ms$0.013$13.35estimate · DGX Spark
Perplexity Decider Flash v1.2 Open · 4.0B

Perplexity Decider Flash v1.2 · Perplexity · decision model

Parameters: 4B dense

Cost $0.004$3.76 list$0.034$34.43estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 55.2%

Its run record (Method) →

—43.1%40.2%–46.0%qrstuvwxy485 / 1,12535 right of 35 kept0 mistakes · 1,090 skipped0.72928.9%answered 82%45 ms55 ms$0.004$3.76 list$0.034$34.43estimate · RTX PRO 6000 Blackwell
Open-Jev-27B-v1.1 Open · 27B

Open-Jev-27B-v1.1 · Zefan Cai · decision model

Parameters: 27B dense

Base model: Qwen3.8-27B + adapter

Cost $0.294$294estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 54.6%

Its run record (Method) →

—42.6%39.7%–45.5%rstuvwxy479 / 1,125No answers at this threshold0.73328.2%answered 82%413 ms576 ms$0.294$294estimate · RTX PRO 6000 Blackwell
KnowLine 4B Gen5.5 Open · 4.0B

KnowLine 4B Gen5.5 · PelaAI · decision model

Parameters: 4B dense

Cost $0.006$5.89estimate · DGX Spark per 1,000 questionsper 1M questions

Math 56.0%

Its run record (Method) →

—42.3%39.5%–45.2%stuvwxy476 / 1,12517 right of 18 kept1 wrong · 1,107 skipped0.7088.3%answered 95%96 ms115 ms$0.006$5.89estimate · DGX Spark
Drex 2.0 Open · 35B MoE · 3.0B active

Drex 2.0 · Nace.AI · decision model

Parameters: 35B MoE · 3B active

Cost $0.018$18.41 per 1,000 questionsper 1M questions

Math 59.0%

Its run record (Method) →

—41.9%39.0%–44.8%stuvwxy471 / 1,12533 right of 33 kept0 mistakes · 1,092 skipped0.71737.7%answered 75%345 ms504 ms$0.018$18.41
Clef Open · 27B

Clef · Cloudflare · decision model

Parameters: 27B dense

Cost $0.106$106 list$0.141$141estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 51.1%

Its run record (Method) →

—40.8%38.0%–43.7%uvwxy459 / 1,1256 right of 6 kept0 mistakes · 1,119 skipped0.6973.6%answered 98%196 ms222 ms$0.106$106 list$0.141$141estimate · RTX PRO 6000 Blackwell
d1 Closed · Efficient

d1 · Liquid AI · decision model

Parameters: not disclosed by maker

Cost $0.006$6.02 per 1,000 questionsper 1M questions

Math 55.6%

Its run record (Method) →

—40.8%38.0%–43.7%tuvwxy459 / 1,12555 right of 56 kept1 wrong · 1,069 skipped0.72311.3%answered 93%188 ms290 ms$0.006$6.02
OneJev-27B Open · 27B

OneJev-27B · OmniJev · decision model

Parameters: 27B dense

Cost $0.086$86.07estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 53.8%

Its run record (Method) →

—40.6%37.8%–43.5%tuvwxy457 / 1,1254 right of 4 kept0 mistakes · 1,121 skipped0.7261.2%answered 99%108 ms136 ms$0.086$86.07estimate · RTX PRO 6000 Blackwell
Chinese Decision Pointer 4B Open · 4.0B

Chinese Decision Pointer 4B · quincyqiang · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Cost $0.030$29.51estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 50.4%

Its run record (Method) →

—40.4%37.5%–43.3%vwxy454 / 1,12539 right of 39 kept0 mistakes · 1,086 skipped0.72414.6%answered 91%38 ms48 ms$0.030$29.51estimate · RTX PRO 6000 Blackwell
Verdin-4B-v1.1 Open · 4.0B

Verdin-4B-v1.1 · victorbennett · decision model

Parameters: 4B dense

Base model: Qwen3.5-4B

Cost $0.033$33.20estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 51.5%

Its run record (Method) →

—39.7%36.9%–42.6%wy447 / 1,12535 right of 35 kept0 mistakes · 1,090 skipped0.72912.6%answered 92%45 ms51 ms$0.033$33.20estimate · RTX PRO 6000 Blackwell
Winnow-12B Open · 12B

Winnow-12B · EldanRing · decision model

Parameters: 12B dense

Cost $0.052$51.64estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 46.9%

Its run record (Method) →

—39.7%36.9%–42.6%xy447 / 1,12532 right of 32 kept0 mistakes · 1,093 skipped0.72729.7%answered 80%66 ms91 ms$0.052$51.64estimate · RTX PRO 6000 Blackwell
Cygnet Open · 12B

Cygnet · Blockbrain Labs · decision model

Parameters: 11.95B dense

Base model: Gemma 4 12B IT

Cost $0.040$39.71 list$0.031$30.74estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 44.3%

Its run record (Method) →

—39.3%36.5%–42.2%xy442 / 1,125No answers at this threshold0.72011.3%answered 93%40 ms48 ms$0.040$39.71 list$0.031$30.74estimate · RTX PRO 6000 Blackwell
Clef-Flash Open · 9.0B

Clef-Flash · Cloudflare · decision model

Parameters: 9B dense

Cost $0.017$16.83 list$0.081$81.16estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 49.8%

Its run record (Method) →

—38.9%36.1%–41.8%yz438 / 1,125No answers at this threshold0.65914.4%answered 91%110 ms137 ms$0.017$16.83 list$0.081$81.16estimate · RTX PRO 6000 Blackwell
GLiDE 2B Open · 1.9B

GLiDE 2B · Fastino · decision model

Parameters: 1.88B dense

Cost $0.002$2.26estimate · DGX Spark per 1,000 questionsper 1M questions

Math 36.8%

Its run record (Method) →

—32.3%29.6%–35.1%zA363 / 1,12514 right of 14 kept0 mistakes · 1,111 skipped0.63232.9%answered 75%34 ms42 ms$0.002$2.26estimate · DGX Spark
Metask-Jev-4B Open · 4.5B

Metask-Jev-4B · Metask Lab · decision model

Parameters: 4.54B dense

Cost $0.091$90.99estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 39.2%

Its run record (Method) →

—32.1%29.4%–34.9%zA361 / 1,125No answers at this threshold0.6601.5%answered 99%123 ms152 ms$0.091$90.99estimate · RTX PRO 6000 Blackwell
KnowLine-2B-Gen1 Open · 2.0B

KnowLine-2B-Gen1 · PelaAI · decision model

Parameters: 2B dense

Base model: Qwen3.5-2B

Cost $0.004$3.78estimate · DGX Spark per 1,000 questionsper 1M questions

Math 35.3%

Its run record (Method) →

—31.7%29.1%–34.5%A357 / 1,1258 right of 8 kept0 mistakes · 1,117 skipped0.60115.7%answered 89%59 ms70 ms$0.004$3.78estimate · DGX Spark
StartLux-Decision-v1.1-2B-Instant Open · 2.0B

StartLux-Decision-v1.1-2B-Instant · StartLux · decision model

Parameters: 2B dense

Cost $0.003$2.52estimate · DGX Spark per 1,000 questionsper 1M questions

Math 38.7%

Its run record (Method) →

—30.8%28.1%–33.5%AB346 / 1,1252 right of 2 kept0 mistakes · 1,123 skipped0.64031.4%answered 76%40 ms45 ms$0.003$2.52estimate · DGX Spark
d1-2B Open · 1.9B

d1-2B · Liquid AI · decision model

Parameters: 1.92B dense

Base model: LFM3-VL-2B

Cost $0.015$14.76estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 37.1%

Its run record (Method) →

—30.7%28.0%–33.4%AB345 / 1,1253 right of 3 kept0 mistakes · 1,122 skipped0.62086.5%answered 22%17 ms23 ms$0.015$14.76estimate · RTX PRO 6000 Blackwell
GLiDE 0.8B Open · 0.8B

GLiDE 0.8B · Fastino · decision model

Parameters: 0.75B dense

Cost $0.002$1.58estimate · DGX Spark per 1,000 questionsper 1M questions

Math 32.1%

Its run record (Method) →

—29.2%26.6%–31.9%ABC328 / 1,1259 right of 9 kept0 mistakes · 1,116 skipped0.61726.1%answered 80%23 ms29 ms$0.002$1.58estimate · DGX Spark
OneJev1.6-0.8B Open · 0.8B

OneJev1.6-0.8B · OmniJev · decision model

Parameters: 0.8B dense

Cost $0.001$1.16estimate · DGX Spark per 1,000 questionsper 1M questions

Math 28.2%

Its run record (Method) →

—27.0%24.5%–29.7%ABC304 / 1,1252 right of 2 kept0 mistakes · 1,123 skipped0.5454.6%answered 97%16 ms19 ms$0.001$1.16estimate · DGX Spark
KnowLine-0.8B-Gen1 Open · 0.8B

KnowLine-0.8B-Gen1 · PelaAI · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Cost $0.002$2.00estimate · DGX Spark per 1,000 questionsper 1M questions

Math 28.2%

Its run record (Method) →

—26.7%24.2%–29.3%ABC300 / 1,1252 right of 2 kept0 mistakes · 1,123 skipped0.5731.2%answered 99%31 ms39 ms$0.002$2.00estimate · DGX Spark
StartLux-Decision-v1.1-0.8B-Instant Open · 0.8B

StartLux-Decision-v1.1-0.8B-Instant · StartLux · decision model

Parameters: 0.8B dense

Base model: Qwen3.5-0.8B

Cost $0.002$1.79estimate · DGX Spark per 1,000 questionsper 1M questions

Math 29.7%

Its run record (Method) →

—24.7%22.3%–27.3%BC278 / 1,125No answers at this threshold0.64121.4%answered 83%27 ms31 ms$0.002$1.79estimate · DGX Spark
GLiClass v4 Edge Open · 0.4B

GLiClass v4 Edge · decision model

Parameters: 0.4B dense

Base model: DeBERTa-v3-large

Cost $0.001$1.31estimate · DGX Spark per 1,000 questionsper 1M questions

Math 22.7%

Its run record (Method) →

—23.6%21.2%–26.1%BC265 / 1,125No answers at this threshold0.52712.4%answered 90%15 ms28 ms$0.001$1.31estimate · DGX Spark
GLiDE 0.4B Open · 0.4B

GLiDE 0.4B · Fastino · decision model

Parameters: 0.40B dense

Cost $0.001$0.95estimate · DGX Spark per 1,000 questionsper 1M questions

Math 20.6%

Its run record (Method) →

—23.2%20.8%–25.8%C261 / 1,125No answers at this threshold0.55676.1%answered 30%13 ms16 ms$0.001$0.95estimate · DGX Spark
Strands Decider 2B Open · 2.0B

Strands Decider 2B · Strands Agents · decision model

Parameters: 2B dense

Cost $0.028$27.67estimate · RTX PRO 6000 Blackwell per 1,000 questionsper 1M questions

Math 28.7%

Its run record (Method) →

—22.4%20.1%–24.9%C252 / 1,125No answers at this threshold0.5688.3%answered 94%36 ms43 ms$0.028$27.67estimate · RTX PRO 6000 Blackwell

Tie groups and “not measured”

estimate · RTX PRO 6000 Blackwell / DGX Spark = run on our own hardware; its cost is an estimate, explained on hover, focus or tap of the amount: the machine's wall-clock time on the run, first to last answer while it was running (pauses, estimated from gaps of more than 10 minutes between answers, left out and listed), × $2.49/h per NVIDIA RTX PRO 6000 Blackwell (96 GB) (Runpod's price for the card) or × $0.213/h per NVIDIA DGX Spark (GB10) (its purchase over three years plus electricity; see Method), each run charged in full even when runs shared the machine, so at most; sorting and the cost chart use the estimate; list = maker's list price × our token counts; unmarked = provider's price × usage the API reported.