Judged questions
The public questions, with how many answers were marked by two judges and how often the judges were 3 or more points apart. Open a question to read both judges' scores and reasons for every model. Private questions are never listed.
| Question | Category | Starts with | Answers judged twice | Disputed | Mean gap | Mean judge score |
|---|---|---|---|---|---|---|
| long_context-004 | Long context | Below are internal documents from Northfold Instruments. Read them carefully, then answer the question that follows the documents. LAB NOTEB… | 0 | — | — | — |
| long_context-009 | Long context | Below are internal documents from Northfold Instruments. Read them carefully, then answer the question that follows the documents. PROJECT S… | 0 | — | — | — |
| long_context-017 | Long context | Below are internal documents from Ostrava Biosystems. Read them carefully, then answer the question that follows the documents. PROJECT STAT… | 0 | — | — | — |
A dash means no answer to the question was scored by two judges. Scores are on the judges' own 0 to 10 scale; withheld models are left out of every figure.