About OpenWeights Bench

OpenWeights Bench is an independent benchmark and review site for open-weight AI models. It takes the most-downloaded open-weight models, runs each one locally on one laptop through a fixed battery of 270 items in 13 categories (reasoning, math, coding, instruction following, knowledge & honesty, long context, multilingual, tool use, safety, pushback resistance, famous gotchas, writing, self-description), measures its speed and memory use, and publishes what happened: the scores, the speed profile, the raw outputs of a public sample, and the written reviews of two judge models.

Principles

What this site is not

It is not a leaderboard of overall model quality. The battery is small, runs at one quantisation and one seed, and judge models are fallible. Treat the results as one set of measurements and read the limitations.

Licence

The results and scores on this site are licensed under CC BY 4.0: you may copy, share and reuse them, including commercially, as long as you credit OpenWeights Bench (openweightsbench.com). This covers our results and scores only. It does not cover the judges’ reviews, the models’ answers, the question texts or the models themselves; each model has its own licence terms.

Contact

Questions or corrections: [email protected].

Updates

New models and new versions of existing models are tested as they appear, and the battery and rubric versions are shown on every run. Results from different battery versions are not directly comparable.