← Best models

Best model for 32 GB of memory

Ranked models that need at most 32 GB, best Overall score first. The memory a model needs is an estimate: the model file size plus about 20% for the context of a single conversation. This is the rule of the hardware page, with the same estimate.

Typical machine for this budget: 32 GB Mac or workstation. That is a label for orientation, not a measurement.

215 of 227 ranked models fit. 5 ranked models have no file size on record, so their memory need cannot be estimated and they are not listed.

Read the memory figure as an estimate, not a guarantee. The memory a model needs is estimated from its file: the weights plus about 20% for the context of a single conversation. It is not a measurement, and a long conversation or several at once needs more. A model with no file size on record is not counted as fitting any amount of memory. Speeds, and the GPU memory shown on the speed page, were measured on this benchmark's server, not on yours. That server kept 1 to 8 answers in flight at a time and loaded a context window of 16,384 tokens for most models; 42 of the models ranked ran at a shorter context. Speeds were measured on one laptop and are comparable only between models on the same backend. See the settings and the memory method.

Up to 32 GB

gemma-4-31B-it is the top-scoring ranked model that fits in 32 GB: Overall 99.3 (95% interval 98.3–100.0), rank range 1–5, needing about 22.4 GB (file size plus 20%). It is not clearly ahead of Gemma 4 12B IT, the second: with this battery the two cannot be told apart with confidence.

Up to 32 GB: the top 5 of 215.
Place Model Overall Rank range Decode (tok/s) Memory needed (GB, est.) Size class
1 gemma-4-31B-it 99.398.3–100.0 1–5 3.8ROCm 7.1 22.4 16–35B
2 Gemma 4 12B IT 98.697.0–99.8 1–12 8.1ROCm 7.1 8.9 9–16B
3 Muse Glimmer 30B 97.996.0–99.3 1–23 3.6ROCm 7.1 21.8 16–35B
4 gemma-4-26B-A4B-it 97.895.8–99.3 1–22 15.7ROCm 7.1 21.6 16–35B
5 Qwen3.5-27B 96.293.8–98.3 3–35 2.7ROCm 7.1 19.9 16–35B

A higher place is not always a clear win. When two models have overlapping rank ranges, this battery cannot tell them apart; see how sure a score is. A dash means not measured or not scored, which is different from 0. Speeds were measured on one laptop and are comparable only between models on the same backend.

More: all the best-model pages, the hardware picker, speed and memory for every model.