Judged questions
The public questions, with how many answers were marked by two judges and how often the judges were 3 or more points apart. Open a question to read both judges' scores and reasons for every model. Private questions are never listed.
| Question | Category | Starts with | Answers judged twice | Disputed | Mean gap | Mean judge score |
|---|---|---|---|---|---|---|
| writing-001 | Writing | Write the opening paragraph of a short story (120 to 160 words) set in a lighthouse. The twist constraint: the narrator must never use the l… | 228 | 28 | 1.1 | 4.5 |
| writing-002 | Writing | Write one persuasive op-ed paragraph (150 to 200 words) arguing that cities should replace a portion of downtown car parking with public gre… | 228 | 10 | 0.9 | 5.1 |
| writing-003 | Writing | Write a polite but firm complaint email (120 to 180 words) to an internet provider. Facts: the customer, Dana Whitfield, has had no service… | 228 | 7 | 1.0 | 5.9 |
| writing-004 | Writing | Explain how the internet gets a web page from a faraway computer to your screen, as if talking to a curious 10-year-old. Use one everyday an… | 228 | 14 | 1.2 | 5.5 |
| writing-005 | Writing | Write a sequence of exactly three haiku (5-7-5 syllables each) about the last week of autumn, where every haiku includes a different colour… | 228 | 9 | 0.7 | 3.9 |
| writing-006 | Writing | Write a product description (80 to 120 words) for a stainless-steel insulated water bottle called 'Ember'. Brand voice: warm, dry-witted, a… | 228 | 7 | 1.1 | 5.4 |
| writing-007 | Writing | Rewrite the following contract paragraph in plain English that a non-lawyer could follow. Keep every obligation and exception, use short sen… | 227 | 52 | 1.6 | 4.7 |
| writing-008 | Writing | Write a comedic dialogue (10 to 14 lines, formatted as 'NAME: line') between Marge, a retired librarian who is obsessed with silence, and Bo… | 228 | 16 | 1.2 | 3.8 |
A dash means no answer to the question was scored by two judges. Scores are on the judges' own 0 to 10 scale; withheld models are left out of every figure.