Best model for tool use under 16 GB
Ranked models that need at most 16 GB, best tool use score first. The memory a model needs is an estimate: the model file size plus about 20% for the context of a single conversation. The score is the one on the category page: 0 to 100, and only models with enough scored items are included.
165 of 227 ranked models fit in 16 GB, and 165 of them have a tool use score on the category page. 5 ranked models have no file size on record, so they are not listed.
Read the memory figure as an estimate, not a guarantee. The memory a model needs is estimated from its file: the weights plus about 20% for the context of a single conversation. It is not a measurement, and a long conversation or several at once needs more. A model with no file size on record is not counted as fitting any amount of memory. Speeds, and the GPU memory shown on the speed page, were measured on this benchmark's server, not on yours. That server kept 1 to 8 answers in flight at a time and loaded a context window of 16,384 tokens for most models; 42 of the models ranked ran at a shorter context. Speeds were measured on one laptop and are comparable only between models on the same backend. See the settings and the memory method.
Up to 16 GB
Aya Expanse 8B leads here with 100.0 on a scale of 0 to 100; its Overall is 72.5 (95% interval 67.5–77.3), needing about 6.1 GB (file size plus 20%).
| Place | Model | Tool use (0 to 100) | Overall | Rank range | Decode (tok/s) | Memory needed (GB, est.) | Size class |
|---|---|---|---|---|---|---|---|
| 1 | Aya Expanse 8B | 100.020 of 20 items scored | 72.567.5–77.3 | 90–154 | 10.7ROCm 7.1 | 6.1 | 4–9B |
| 1 | Cogito 14B V1 Preview Qwenfine-tune of Qwen 2.5 | 100.020 of 20 items scored | 90.386.8–93.4 | 11–79 | 6.6ROCm 7.1 | 10.8 | 9–16B |
| 1 | Cogito 8B V1 Preview Llamafine-tune of Llama 3.1 | 100.020 of 20 items scored | 83.979.6–87.8 | 47–105 | 11.2ROCm 7.1 | 5.9 | 4–9B |
| 1 | Deepcoder 14B Previewfine-tune of DeepSeek-R1-Distill-Qwen 14Bcode model | 100.020 of 20 items scored | 74.569.5–79.0 | 84–146 | 6.7ROCm 7.1 | 10.8 | 9–16B |
| 1 | Deepseek R1 8B Llama Distill | 100.020 of 20 items scored | 81.776.9–86.1 | 56–122 | 11.9ROCm 7.1 | 5.9 | 4–9B |
A higher place is not always a clear win. When two models have overlapping rank ranges, this battery cannot tell them apart; see how sure a score is. A dash means not measured or not scored, which is different from 0. Speeds were measured on one laptop and are comparable only between models on the same backend.
More: all the best-model pages, the hardware picker, speed and memory for every model.