Judged questions
The public questions, with how many answers were marked by two judges and how often the judges were 3 or more points apart. Open a question to read both judges' scores and reasons for every model. Private questions are never listed.
| Question | Category | Starts with | Answers judged twice | Disputed | Mean gap | Mean judge score |
|---|---|---|---|---|---|---|
| reasoning-004 | Reasoning | A movie starts at 19:45 (24-hour clock) and runs for 2 hours 20 minutes. What time does it end? Answer in 24-hour HH:MM format. Give your fi… | 228 | 8 | 0.8 | 6.8 |
| reasoning-010 | Reasoning | A bag contains 4 red balls and 6 blue balls. What is the probability of drawing a red ball? Give your answer as a decimal rounded to 2 place… | 228 | 7 | 0.8 | 8.7 |
| reasoning-018 | Reasoning | Amy, Ben, Cara, and Dev sit in a row of 4 seats numbered 1 to 4 from left to right as seen from the front, and 'left of' means a lower seat… | 227 | 6 | 0.6 | 4.4 |
A dash means no answer to the question was scored by two judges. Scores are on the judges' own 0 to 10 scale; withheld models are left out of every figure.