topic
Reasoning
1 post tagged Reasoning.
AI Models3 min read
Qwen3.8 27B Adds in Words: 97% on Short Numbers, 6% on Long Ones
Simon Willison reran a GPT-4o arithmetic experiment on a local Qwen3.8 27B. Without reasoning, accuracy collapses as numbers get longer, and turning reasoning on nearly fixes it.
- llm
- qwen
- local-models
- evals
- reasoning