What runs on my hardware
Enter the memory you can give a model, in GB. This page lists the ranked models whose estimated memory need fits, best Overall score first. The estimate is the model file size plus about 20% for the context of a single conversation. You can also set the slowest speed you would accept. Back to the leaderboard.
Read the memory figure as an estimate, not a guarantee. The memory a model needs is estimated from its file: the weights plus about 20% for the context of a single conversation. It is not a measurement, and a long conversation or several at once needs more. A model with no file size on record is not counted as fitting any amount of memory. Speeds, and the GPU memory shown on the speed page, were measured on this benchmark's server, not on yours. That server kept 1 to 8 answers in flight at a time and loaded a context window of 16,384 tokens for most models; 42 of the models ranked ran at a shorter context. Speeds were measured on one laptop and are comparable only between models on the same backend. See the settings and the memory method.
Enter an amount of memory, or pick one above, to see the models that fit.
The full speed and memory table is on the Speed page.