← Leaderboard

Run r20261016-bv1-473145

Status
finished
Battery version
v1
Started
2026-10-16T07:26:20.138Z
Finished
2026-10-26T08:44:57.631Z
Ollama version
0.40.4
GPU / backend
AMD Radeon 8060S (Ryzen AI Max+ 395, 128 GB unified, ~78 GB GPU)
Operating system
Windows

Models in this run

Generation status per model version in run r20261016-bv1-473145
ModelOllama referenceQuantGenerationsOKTruncatedFailedPendingPublished
Aya 8B 23 aya:8b-23-q4_K_MF16 270268200 yes
Aya Expanse 8B aya-expanse:8b-q4_K_MQ4_K_M 270270000 yes
Codegeex4 9B All codegeex4:9b-all-q4_K_MQ4_K_M 270264600 yes
Codegemma 2B Code V1.1 codegemma:2b-code-v1.1-q4_K_MQ4_K_M 27015511500 yes
Codegemma 7B Instruct V1.1 codegemma:7b-instruct-v1.1-q4_K_MQ4_K_M 270269100 yes
Codeqwen 7B Chat V1.5 codeqwen:7b-chat-v1.5-q4_K_MQ4_K_M 270262800 yes
Cogito 14B V1 Preview Qwen cogito:14b-v1-preview-qwen-q4_K_MQ4_K_M 270270000 yes
Cogito 3B V1 Preview Llama cogito:3b-v1-preview-llama-q4_K_MQ4_K_M 270269100 yes
Cogito 8B V1 Preview Llama cogito:8b-v1-preview-llama-q4_K_MQ4_K_M 270267300 yes
Command R7B Arabic 7B 02 2025 command-r7b-arabic:7b-02-2025-q4_K_MQ4_K_M 270267300 yes
Deepcoder 1.5B Preview deepcoder:1.5b-preview-q4_K_MQ4_K_M 2702185200 yes
Deepcoder 14B Preview deepcoder:14b-preview-q4_K_MQ4_K_M 2702135700 yes
Deepscaler 1.5B Preview deepscaler:1.5b-preview-q4_K_MQ4_K_M 2702056500 yes
Deepseek Coder 1.3B Instruct deepseek-coder:1.3b-instruct-q4_K_MQ4_K_M 270263700 yes
Deepseek Llm 7B Chat deepseek-llm:7b-chat-q4_K_MQ4_K_M 270267300 yes
Deepseek R1 1.5B Qwen Distill deepseek-r1:1.5b-qwen-distill-q4_K_MQ4_K_M 2702076300 yes
Deepseek R1 8B Llama Distill deepseek-r1:8b-llama-distill-q4_K_MQ4_K_M 2702551500 yes
Deepseek V2 16B Lite Chat deepseek-v2:16b-lite-chat-q4_K_MQ4_K_M 270266400 yes
Dolphin Phi 2.7B V2.6 dolphin-phi:2.7b-v2.6-q4_K_MQ4_K_M 2702482200 yes
Exaone Deep 2.4B exaone-deep:2.4b-q4_K_MQ4_K_M 2701898100 yes
Exaone Deep 7.8B exaone-deep:7.8b-q4_K_MQ4_K_M 2702234700 yes
Exaone3.5 2.4B Instruct exaone3.5:2.4b-instruct-q4_K_MQ4_K_M 270268200 yes
Falcon2 11B falcon2:11b-q4_K_MQ4_K_M 2702234160 yes
Falcon3 10B Instruct falcon3:10b-instruct-q4_K_MQ4_K_M 270269100 withheld from the ranking
Falcon3 1B Instruct falcon3:1b-instruct-q4_K_MQ4_K_M 2702561400 withheld from the ranking
Falcon3 3B Instruct falcon3:3b-instruct-q4_K_MQ4_K_M 270268200 withheld from the ranking
Falcon3 7B Instruct falcon3:7b-instruct-q4_K_MQ4_K_M 270268200 withheld from the ranking
Gemma 2B Instruct V1.1 gemma:2b-instruct-v1.1-q4_K_MQ4_K_M 270261900 yes
Gemma 7B Instruct V1.1 gemma:7b-instruct-v1.1-q4_K_MQ4_K_M 270270000 yes
Gemma2 2B Instruct gemma2:2b-instruct-q4_K_MQ4_K_M 270269100 yes
Gemma3 1B IT gemma3:1b-it-q4_K_MQ4_K_M 2702452500 yes
Gemma3n E2B IT gemma3n:e2b-it-q4_K_MQ4_K_M 2702373300 yes
Gemma4 E2B IT gemma4:e2b-it-q4_K_MQ4_K_M 2702551500 yes
Gemma4 E4B IT gemma4:e4b-it-q4_K_MQ4_K_M 2702531700 yes
Glm4 9B Chat glm4:9b-chat-q4_K_MQ4_K_M 270268200 yes
Granite Code 3B Instruct granite-code:3b-instruct-q4_K_MQ4_K_M 2702581200 yes
Granite Code 8B Instruct granite-code:8b-instruct-q4_K_MQ4_K_M 270268200 yes
Granite3 Dense 2B Instruct granite3-dense:2b-instruct-q4_K_MQ4_K_M 270266400 yes
Granite3 Dense 8B Instruct granite3-dense:8b-instruct-q4_K_MQ4_K_M 270265500 yes
Granite3 Moe 1B Instruct granite3-moe:1b-instruct-q4_K_MQ4_K_M 270261900 yes
Granite3 Moe 3B Instruct granite3-moe:3b-instruct-q4_K_MQ4_K_M 270263700 yes
Granite3.1 Dense 2B Instruct granite3.1-dense:2b-instruct-q4_K_MQ4_K_M 270266400 yes
Granite3.1 Dense 8B Instruct granite3.1-dense:8b-instruct-q4_K_MQ4_K_M 270270000 yes
Granite3.1 Moe 1B Instruct granite3.1-moe:1b-instruct-q4_K_MQ4_K_M 2702452500 yes
Granite3.1 Moe 3B Instruct granite3.1-moe:3b-instruct-q4_K_MQ4_K_M 270264600 yes
Granite3.2 2B Instruct granite3.2:2b-instruct-q4_K_MQ4_K_M 270265500 yes
Granite3.2 8B Instruct granite3.2:8b-instruct-q4_K_MQ4_K_M 270268200 yes
Granite3.3 2B granite3.3:2bQ4_K_M 270267300 yes
Granite3.3 8B granite3.3:8bQ4_K_M 270269100 yes
Granite4 1B H granite4:1b-hQ8_0 270268200 yes
Granite4 350M H granite4:350m-hQ8_0 270270000 yes
Granite4 3B granite4:3bQ4_K_M 270270000 yes
Granite4 Micro H granite4:micro-hQ4_K_M 270269100 yes
Granite4 Tiny H granite4:tiny-hQ4_K_M 270268200 yes
Granite4.1 8B granite4.1:8b-q4_K_MQ4_K_M 270269100 yes
Hermes3 3B Llama3.2 hermes3:3b-llama3.2-q4_K_MQ4_K_M 270268200 yes
Internlm2 1.8B Chat V2.5 internlm2:1.8b-chat-v2.5-q4_K_MQ4_K_M 270264600 withheld from the ranking
Internlm2 7B Chat V2.5 internlm2:7b-chat-v2.5-q4_K_MQ4_K_M 270263700 yes
Lfm2.5 8B A1B lfm2.5:8b-a1b-q4_K_MQ4_K_M 2702125800 yes
Lfm2.5 Thinking 1.2B lfm2.5-thinking:1.2b-q4_K_MQ4_K_M 2702353500 yes
Llama3.2 1B Instruct llama3.2:1b-instruct-q4_K_MQ4_K_M 270264600 yes
Marco O1 7B marco-o1:7b-q4_K_MQ4_K_M 270267300 yes
Mathstral 7B V0.1 mathstral:7b-v0.1-q4_K_MQ4_K_M 270263700 yes
Medgemma1.5 4B IT medgemma1.5:4b-it-q4_K_MQ4_K_M 27014312700 results computed, run not finished
Ministral 3 3B Instruct 2512 ministral-3:3b-instruct-2512-q4_K_MQ4_K_M 2702571300 yes
Ministral 3 8B Instruct 2512 ministral-3:8b-instruct-2512-q4_K_MQ4_K_M 2702521800 yes
Mistral 7B Instruct V0.3 mistral:7b-instruct-v0.3-q4_K_MQ4_K_M 270267300 yes
Mistral Nemo 12B Instruct 2407 mistral-nemo:12b-instruct-2407-q4_K_MQ4_K_M 270268200 yes
Nemotron Mini 4B Instruct nemotron-mini:4b-instruct-q4_K_MQ4_K_M 270266400 yes
Olmo2 7B 1124 Instruct olmo2:7b-1124-instruct-q4_K_MQ4_K_M 270269100 yes
Opencoder 1.5B Instruct opencoder:1.5b-instruct-q4_K_MQ4_K_M 2702422800 yes
Openthinker 7B V2 openthinker:7b-v2-q4_K_MQ4_K_M 2702313900 yes
Ornith 9B ornith:9b-q4_K_MQ4_K_M 270265500 yes
Phi 2.7B Chat V2 phi:2.7b-chat-v2-q4_K_MQ4_K_M 2702383200 yes
Phi3 14B Medium 128K Instruct phi3:14b-medium-128k-instruct-q4_K_MQ4_K_M 270263700 yes
Phi3 3.8B Mini 128K Instruct phi3:3.8b-mini-128k-instruct-q4_K_MQ4_K_M 2702591100 yes
Phi4 Mini Reasoning 3.8B phi4-mini-reasoning:3.8b-q4_K_MQ4_K_M 2702304000 yes
Qwen 0.5B Chat V1.5 qwen:0.5b-chat-v1.5-q4_K_MQ4_K_M 2702581200 yes
Qwen 1.8B Chat V1.5 qwen:1.8b-chat-v1.5-q4_K_MQ4_K_M 2702244600 yes
Qwen 4B Chat V1.5 qwen:4b-chat-v1.5-q4_K_MQ4_K_M 270261900 yes
Qwen2 0.5B Instruct qwen2:0.5b-instruct-q4_K_MQ4_K_M 2702452500 yes
Qwen2 1.5B Instruct qwen2:1.5b-instruct-q4_K_MQ4_K_M 2702551500 yes
Qwen2 Math 1.5B Instruct qwen2-math:1.5b-instruct-q4_K_MQ4_K_M 2702452500 withheld from the ranking
Qwen2 Math 7B Instruct qwen2-math:7b-instruct-q4_K_MQ4_K_M 270266400 withheld from the ranking
Qwen2.5 0.5B Instruct qwen2.5:0.5b-instruct-q4_K_MQ4_K_M 2702571300 yes
Qwen2.5 1.5B Instruct qwen2.5:1.5b-instruct-q4_K_MQ4_K_M 270263700 yes
Qwen2.5 Coder 0.5B Instruct qwen2.5-coder:0.5b-instruct-q4_K_MQ4_K_M 2702511900 yes
Qwen2.5 Coder 1.5B Instruct qwen2.5-coder:1.5b-instruct-q4_K_MQ4_K_M 2702601000 yes
Qwen3 0.6B qwen3:0.6b-q4_K_MQ4_K_M 270261900 yes
Qwen3 1.7B qwen3:1.7b-q4_K_MQ4_K_M 270263700 yes
Qwen3 VL 2B Instruct qwen3-vl:2b-instruct-q4_K_MQ4_K_M 2702284200 yes
Qwen3 VL 2B Thinking qwen3-vl:2b-thinking-q4_K_MQ4_K_M 27014812200 yes
Qwen3.5 2B qwen3.5:2b-q4_K_MQ4_K_M 2702482200 yes
Sailor2 1B Chat sailor2:1b-chat-q4_K_MQ4_K_M 2702551500 yes
Sailor2 8B Chat sailor2:8b-chat-q4_K_MQ4_K_M 270268200 yes
Smallthinker 3B Preview smallthinker:3b-preview-q4_K_MQ4_K_M 2702195100 yes
Smollm2 1.7B Instruct smollm2:1.7b-instruct-q4_K_MQ4_K_M 270263700 yes
Smollm2 135M Instruct smollm2:135m-instruct-q4_K_MQ4_K_M 2702086200 yes
Smollm2 360M Instruct smollm2:360m-instruct-q4_K_MQ4_K_M 2702383200 yes
Solar 10.7B Instruct V1 solar:10.7b-instruct-v1-q4_K_MQ4_K_M 270270000 yes
Stable Code 3B Instruct stable-code:3b-instruct-q4_K_MQ4_K_M 2702363400 yes
Stablelm Zephyr 3B stablelm-zephyr:3b-q4_K_MQ4_K_M 270269100 yes
Stablelm2 1.6B Chat stablelm2:1.6b-chat-q4_K_MQ4_K_M 270263700 yes
Stablelm2 12B Chat stablelm2:12b-chat-q4_K_MQ4_K_M 270270000 yes
Translategemma 12B IT translategemma:12b-it-q4_K_MQ4_K_M 2702511900 yes
Tulu3 8B tulu3:8b-q4_K_MQ4_K_M 270270000 yes
YI 6B Chat V1.5 yi:6b-chat-v1.5-q4_K_MQ4_K_M 2702601000 yes
YI 9B Chat V1.5 yi:9b-chat-v1.5-q4_K_MQ4_K_M 270267300 yes
YI Coder 1.5B Chat yi-coder:1.5b-chat-q4_K_MQ4_K_M 2702432700 yes
YI Coder 9B Chat yi-coder:9b-chat-q4_K_MQ4_K_M 270266400 yes

Event log (latest 50)

Most recent events for this run, newest first. Only time, level and kind are published; event text stays private.
TimeLevelKind
2026-11-05T14:18:10.832Zinfojudge_api_batch
2026-11-05T13:53:08.177Zinforescored
2026-10-28T03:14:09.086Zinfojudge_api_batch
2026-10-28T00:10:42.401Zinfojudge_api_batch
2026-10-28T00:10:19.402Zinfojudge_api_batch
2026-10-26T08:44:57.631Zinforun_finished
2026-10-26T08:44:57.629Zinfoextensions_backfill
2026-10-26T08:44:57.567Zinfoextensions_done
2026-10-25T18:40:15.895Zinfoextensions_backfill
2026-10-25T18:40:15.832Zinfoextensions_done
2026-10-25T18:40:15.829Zwarnextension_failed
2026-10-25T18:40:15.814Zwarnextension_failed
2026-10-25T18:40:15.784Zwarnextension_failed
2026-10-25T18:40:15.727Zwarnextension_failed
2026-10-25T17:45:01.299Zwarnextension_failed
2026-10-25T17:20:58.228Zwarnextension_failed
2026-10-25T16:40:15.807Zwarnextension_failed
2026-10-25T16:40:15.789Zwarnextension_failed
2026-10-25T16:40:15.769Zwarnextension_failed
2026-10-25T16:40:15.746Zwarnextension_failed
2026-10-25T16:40:15.724Zwarnextension_failed
2026-10-25T16:40:15.695Zwarnextension_failed
2026-10-25T15:45:01.272Zwarnextension_failed
2026-10-25T15:20:58.197Zwarnextension_failed
2026-10-25T14:40:15.748Zwarnextension_failed
2026-10-25T14:40:15.729Zwarnextension_failed
2026-10-25T14:40:15.711Zwarnextension_failed
2026-10-25T14:40:15.691Zwarnextension_failed
2026-10-25T14:40:15.671Zwarnextension_failed
2026-10-25T14:40:15.648Zwarnextension_failed
2026-10-25T12:26:41.015Zinfoextensions_done
2026-10-25T12:23:58.720Zinfoconcurrency_chosen
2026-10-25T12:08:27.255Zwarnhost_offline
2026-10-25T12:08:16.441Zinfoextensions_done
2026-10-25T11:13:21.106Zinfoconcurrency_chosen
2026-10-25T11:12:31.480Zinfoextensions_done
2026-10-25T11:11:34.361Zinfoconcurrency_chosen
2026-10-25T11:11:05.474Zinfoextensions_done
2026-10-25T11:04:31.191Zinfoconcurrency_chosen
2026-10-25T11:04:24.415Zinfoextensions_done
2026-10-25T11:03:50.187Zinfoconcurrency_chosen
2026-10-25T11:02:13.946Zinfoextensions_done
2026-10-25T09:24:47.262Zinfoconcurrency_chosen
2026-10-25T09:24:47.262Zinfoperf_done
2026-10-25T09:14:43.022Zinfomodel_loaded
2026-10-25T09:10:33.124Zinfoextensions_done
2026-10-25T07:08:23.468Zwarnextension_failed
2026-10-25T06:44:11.330Zwarnextension_failed
2026-10-25T06:44:11.275Zwarnextension_failed
2026-10-25T06:25:04.694Zwarnextension_failed

This run as JSON