chat model, one letter · New models: first look (50 smoke positions)
Claude Haiku 5.5high
Smoke test
Results f24d1f41, updated 16 November 2026, 22:20 UTC; scored by GNU Backgammon 1.08, 2-ply.
How we called it
- Model ID
- claude-haiku-5-5
- Provider or endpoint
- Claude subscription
- Date run
- 2026-10-21
- Price
- $0.1 / $0.5 per million tokens in / out; API-equivalent (subscription); price date 2026-10-21
- Model type
- chat model, one letter
- Weights
- closed
- Runs on
- subscription
- Reasoning setting
- effort high
- Confidence source
- none
- Rules text
- long
- Option groups
- one request (no split)
- Sampling settings
- not sent (API default)
- Notes
- Missing
Smoke test
- Positions answered
- 50 of 50 (0 failed, 0 timed out)
- Invalid answers
- 0
- Error rate (PR)
- 21.1 (95% interval 10.1 to 33.9)
- Median / P90 request s
- 3.2 / 6.2
- $ per 1,000 decisions
- 0.69