← The judge room

Judged questions

The public questions, with how many answers were marked by two judges and how often the judges were 3 or more points apart. Open a question to read both judges' scores and reasons for every model. Private questions are never listed.

8 public questions in one category, battery v1.
QuestionCategoryStarts withAnswers judged twiceDisputedMean gapMean judge score
writing-001 Writing Write the opening paragraph of a short story (120 to 160 words) set in a lighthouse. The twist constraint: the narrator must never use the l… 228 28 1.1 4.5
writing-002 Writing Write one persuasive op-ed paragraph (150 to 200 words) arguing that cities should replace a portion of downtown car parking with public gre… 228 10 0.9 5.1
writing-003 Writing Write a polite but firm complaint email (120 to 180 words) to an internet provider. Facts: the customer, Dana Whitfield, has had no service… 228 7 1.0 5.9
writing-004 Writing Explain how the internet gets a web page from a faraway computer to your screen, as if talking to a curious 10-year-old. Use one everyday an… 228 14 1.2 5.5
writing-005 Writing Write a sequence of exactly three haiku (5-7-5 syllables each) about the last week of autumn, where every haiku includes a different colour… 228 9 0.7 3.9
writing-006 Writing Write a product description (80 to 120 words) for a stainless-steel insulated water bottle called 'Ember'. Brand voice: warm, dry-witted, a… 228 7 1.1 5.4
writing-007 Writing Rewrite the following contract paragraph in plain English that a non-lawyer could follow. Keep every obligation and exception, use short sen… 227 52 1.6 4.7
writing-008 Writing Write a comedic dialogue (10 to 14 lines, formatted as 'NAME: line') between Marge, a retired librarian who is obsessed with silence, and Bo… 228 16 1.2 3.8

A dash means no answer to the question was scored by two judges. Scores are on the judges' own 0 to 10 scale; withheld models are left out of every figure.