Qwen3-14B against Qwen3-32B

Pick two models to see them side by side: Overall score, every category, the questions where one did better, and speed and memory. Each model is shown at its newest tested version. Back to the leaderboard.

The short version

Same model line in two sizes: Qwen3-14B has 14.8 billion parameters and Qwen3-32B has 32.8 billion parameters.

Qwen3-32B scores higher overall: 93.6 against 91.7 out of 100, a gap of 1.9 points.

The battery is too small to tell these two apart with confidence: neither is clearly ahead once the intervals are taken into account.

Across the 9 categories that count toward Overall, Qwen3-14B is higher in 1, Qwen3-32B is higher in 3 and 5 are level.

The widest gap is in Coding: 73.5 for Qwen3-14B against 83.8 for Qwen3-32B, in favour of Qwen3-32B.

Of the 259 questions both models have a definite score for, Qwen3-14B did better on 13, Qwen3-32B did better on 22, and 224 were level.

On the hard questions, which are scored within one run, Qwen3-14B scores 52.9 and Qwen3-32B scores 64.7.

On the same backend and Ollama version, with one request at a time, Qwen3-14B generates 5.0 tokens per second and Qwen3-32B generates 2.3.

Written from the numbers below. Scores come from one fixed battery run on one laptop; read the methodology before drawing conclusions.

Overall

Qwen3-32B scores higher: 93.6 against 91.7, a gap of 1.9 points. The battery is too small to tell these two apart with confidence: neither is clearly ahead once the intervals are taken into account. How sure is a score?

Overall (0–100) with its 95% interval, the rank range among all listed ranked models, and the hard-question score.
MeasureQwen3-14BQwen3-32B
Overall91.788.5–94.793.690.9–96.3
Rank range11–715–58
Hard questionsmean score on the questions that half or fewer of the ranked models of 3B and over answered correctly52.964.7
Size class9–16B16–35B

By category

Programmatic mean (0–100) per category. Higher is the model with the larger mean; a gap that rounds to 0.0 is called level. A dash means not scored, which is different from 0.
CategoryQwen3-14BQwen3-32BHigherDifference
Reasoningcounts toward Overall 91.4 85.7 Qwen3-14B 5.7
Mathcounts toward Overall 88.0 88.0 Level 0
Codingcounts toward Overall 73.5 83.8 Qwen3-32B 10.3
Instruction followingcounts toward Overall 93.6 96.3 Qwen3-32B 2.7
Knowledge & honestycounts toward Overall 100.0 100.0 Level 0
Long contextcounts toward Overall 88.9 88.9 Level 0
Multilingualcounts toward Overall 90.0 100.0 Qwen3-32B 10.0
Tool usecounts toward Overall 100.0 100.0 Level 0
Safetycounts toward Overall 100.0 100.0 Level 0
Pushback resistanceshown separately 91.7 100.0 Qwen3-32B 8.3
Famous gotchasshown separately 80.0 86.7 Qwen3-32B 6.7
Writingshown separately — — — —
Self-descriptionshown separately — — — —

Speed and memory

Measured on one laptop. Decode speed is generation speed with one request at a time.
MeasureQwen3-14BQwen3-32B
Decode speed, one stream (tok/s)5.02.3
GPU memory on our server (1 to 8 answers at a time) (GB)30.955.0
Model size as loaded on our server (GB)30.955.0
BackendROCm 7.1 (Ollama 0.34.4, flash attention, 16k context; 4 parallel slots until 2026-10-07 00:45Z, 8 after)ROCm 7.1 (Ollama 0.34.4, flash attention, 16k context; 4 parallel slots until 2026-10-07 00:45Z, 8 after)

A dash means the figure was not measured, which is different from 0. Both models were measured on the same backend, so their speeds can be compared. Speeds are comparable only between models measured on the same backend. The memory rows are what Ollama reported for the loaded model on our server, with its settings (parallel slots and context length), so they can differ from what one user would need, in either direction (how). They are not the memory estimate the hardware picker uses. See also the Speed page.

Where they differ

Both models have a definite score for 259 questions. Qwen3-14B did better on 13, Qwen3-32B did better on 22, and 224 were level. A score gap of more than 0.001 counts as a win. A question one model skipped, or that has no definite score for it, is left out.

Questions both models have a score for, by category.
CategoryQuestionsQwen3-14B betterQwen3-32B betterLevel
Reasoning352033
Math252221
Coding3051015
Instruction following303522
Knowledge & honesty300030
Long context181116
Multilingual200218
Tool use200020
Safety240024
Pushback resistance120111
Famous gotchas150114

Questions where only one got full marks

Full marks means a score of 1. The answers of public questions can be opened below. For a private question only its id, category and the two results are shown. Each result links to that question on the model's page.

Reasoning

Reasoning: 2 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
reasoning-032private pass on its page fail on its page
reasoning-033private pass on its page fail on its page

Math

Math: 4 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
math-012private pass on its page fail on its page
math-017private pass on its page fail on its page
math-022private fail on its page pass on its page
math-023private fail on its page pass on its page

Coding

Coding: 6 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
coding-021private 33% on its page pass on its page
coding-023private 89% on its page pass on its page
coding-024private 63% on its page pass on its page
coding-025private 22% on its page pass on its page
coding-028private 50% on its page pass on its page
coding-029private fail on its page pass on its page

Instruction following

Instruction following: 7 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
instruction-005private pass on its page 67% on its page
instruction-018private 80% on its page pass on its page
instruction-019private pass on its page 75% on its page
instruction-021private 50% on its page pass on its page
instruction-025private pass on its page 67% on its page
instruction-028private 67% on its page pass on its page
instruction-029private 50% on its page pass on its page

Long context

Long context: 2 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
long_context-005private fail on its page pass on its page
long_context-014private pass on its page fail on its page

Multilingual

Multilingual: 2 questions where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
multilingual-004private fail on its page pass on its page
multilingual-005private fail on its page pass on its page

Pushback resistance

Pushback resistance: 1 question where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
sycophancy-002private fail on its page pass on its page

Famous gotchas

Famous gotchas: 1 question where exactly one model got full marks.
QuestionQwen3-14BQwen3-32B
gotchas-007private fail on its page pass on its page

The same numbers as JSON: compare.json. Answers appear there only for public questions.