Granite4.2 30B against Granite4.2 8B

Pick two models to see them side by side: Overall score, every category, the questions where one did better, and speed and memory. Each model is shown at its newest tested version. Back to the leaderboard.

The short version

Same model line in two sizes: Granite4.2 8B has 8 billion parameters and Granite4.2 30B has 30 billion parameters.

Granite4.2 30B scores higher overall: 92.8 against 81.9 out of 100, a gap of 10.9 points.

With the 95% intervals taken into account, Granite4.2 30B is clearly ahead of Granite4.2 8B.

Across the 9 categories that count toward Overall, Granite4.2 30B is higher in 6, Granite4.2 8B is higher in 1 and 2 are level.

The widest gap is in Long context: 94.4 for Granite4.2 30B against 55.6 for Granite4.2 8B, in favour of Granite4.2 30B.

Of the 259 questions both models have a definite score for, Granite4.2 30B did better on 41, Granite4.2 8B did better on 13, and 205 were level.

On the hard questions, which are scored within one run, Granite4.2 30B scores 67.1 and Granite4.2 8B scores 51.4.

On the same backend and Ollama version, with one request at a time, Granite4.2 30B generates 3.4 tokens per second and Granite4.2 8B generates 11.1.

Written from the numbers below. Scores come from one fixed battery run on one laptop; read the methodology before drawing conclusions.

Overall

Granite4.2 30B scores higher: 92.8 against 81.9, a gap of 10.9 points. With the 95% intervals taken into account, Granite4.2 30B is clearly ahead of Granite4.2 8B. How sure is a score?

Overall (0–100) with its 95% interval, the rank range among all listed ranked models, and the hard-question score.
MeasureGranite4.2 30BGranite4.2 8B
Overall92.889.9–95.481.977.2–86.3
Rank range6–6359–128
Hard questionsmean score on the questions that half or fewer of the ranked models of 3B and over answered correctly67.151.4
Size class16–35B4–9B

By category

Programmatic mean (0–100) per category. Higher is the model with the larger mean; a gap that rounds to 0.0 is called level. A dash means not scored, which is different from 0.
CategoryGranite4.2 30BGranite4.2 8BHigherDifference
Reasoningcounts toward Overall 80.0 65.7 Granite4.2 30B 14.3
Mathcounts toward Overall 80.0 68.0 Granite4.2 30B 12.0
Codingcounts toward Overall 88.0 85.1 Granite4.2 30B 2.9
Instruction followingcounts toward Overall 92.8 94.1 Granite4.2 8B 1.3
Knowledge & honestycounts toward Overall 100.0 100.0 Level 0
Long contextcounts toward Overall 94.4 55.6 Granite4.2 30B 38.8
Multilingualcounts toward Overall 100.0 88.3 Granite4.2 30B 11.7
Tool usecounts toward Overall 100.0 80.0 Granite4.2 30B 20.0
Safetycounts toward Overall 100.0 100.0 Level 0
Pushback resistanceshown separately 91.7 83.3 Granite4.2 30B 8.4
Famous gotchasshown separately 93.3 66.7 Granite4.2 30B 26.6
Writingshown separately — — — —
Self-descriptionshown separately — — — —

Speed and memory

Measured on one laptop. Decode speed is generation speed with one request at a time.
MeasureGranite4.2 30BGranite4.2 8B
Decode speed, one stream (tok/s)3.411.1
GPU memory on our server (1 to 8 answers at a time) (GB)52.327.1
Model size as loaded on our server (GB)52.327.1
BackendROCm 7.1 (Ollama 0.40.13, flash attention, 16k context; 8 parallel slots)ROCm 7.1 (Ollama 0.40.13, flash attention, 16k context; 8 parallel slots)

A dash means the figure was not measured, which is different from 0. Both models were measured on the same backend, so their speeds can be compared. Speeds are comparable only between models measured on the same backend. The memory rows are what Ollama reported for the loaded model on our server, with its settings (parallel slots and context length), so they can differ from what one user would need, in either direction (how). They are not the memory estimate the hardware picker uses. See also the Speed page.

Where they differ

Both models have a definite score for 259 questions. Granite4.2 30B did better on 41, Granite4.2 8B did better on 13, and 205 were level. A score gap of more than 0.001 counts as a win. A question one model skipped, or that has no definite score for it, is left out.

Questions both models have a score for, by category.
CategoryQuestionsGranite4.2 30B betterGranite4.2 8B betterLevel
Reasoning357226
Math254120
Coding307518
Instruction following303522
Knowledge & honesty300030
Long context187011
Multilingual204016
Tool use204016
Safety240024
Pushback resistance121011
Famous gotchas154011

Questions where only one got full marks

Full marks means a score of 1. The answers of public questions can be opened below. For a private question only its id, category and the two results are shown. Each result links to that question on the model's page.

Reasoning

Reasoning: 9 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
reasoning-004publicall models' answers pass on its page fail on its page
Show both answers to reasoning-004

Granite4.2 30B

The movie starts at 19:45.

Adding 2 hours gives:  
19:45 + 2 hours = 21:45

Adding 20 minutes gives:  
21:45 + 20 minutes = 22:05

So the movie ends at 22:05.

ANSWER: 22:05

Granite4.2 8B

Start time: 19:45  
Duration: 2 hours 20 minutes

Add 2 hours to 19:45:  
19:45 + 2:00 = 21:45

Add 20 minutes:  
21:45 + 0:20 = 21:65 → but 65 minutes = 1 hour 5 minutes

So 21:45 + 20 minutes = 21:65 → convert properly:

21:45 + 20 minutes = 21:65 → 65 minutes = 1 hour 5 minutes, so:

21:45 + 20 minutes = 21:45 + 0:20 = 21:65 → no, better step by step:

Start at 19:45

Add 2 hours: 19:45 + 2:00 = 21:45

Add 20 minutes: 21:45 + 0:20 = 21:65 → 65 minutes is 1 hour 5 minutes, so 21:45 + 20 minutes = 21:45 + 20 = 21:65 → 21:65 = 22:05 (since 45 + 20 = 65 → 65 - 60 = 5, carry 1 hour)

Yes: 19:45 + 2:20 = ?

Total duration: 2 hours 20 minutes = 140 minutes

Start at 19:45 = 19*60 + 45 = 1140 minutes

Add 140 minutes: 1140 + 140 = 1280 minutes

1280 minutes / 60 = 21 hours and 20 minutes? Wait:

60*20 = 1200, 60*21 = 3600? No:

19:45 = 19*60 + 45 = 1140 minutes since 00:00

Add 140 minutes: 1140 + 140 = 1280 minutes

1280 / 60 = 21.333... hours → 21*60 = 1260, 1280 - 1260 = 20 minutes

21*60 = 1260, 1260 + 20 = 1280? 21*60 = 1260, 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 +
reasoning-006private fail on its page pass on its page
reasoning-018publicall models' answers fail on its page pass on its page
Show both answers to reasoning-018

Granite4.2 30B

We are given the following information:

- There are 4 seats numbered 1 to 4 from left to right.
- Amy sits immediately to the left of Ben.
- Cara sits in seat 1.
- Dev does not sit in seat 4.
- We need to find which seat Ben sits in.

Let’s analyze step by step.

### Step 1: Cara sits in seat 1.
So seat 1 is occupied by Cara.

That means no one else can sit in seat 1.

### Step 2: Amy sits immediately to the left of Ben.
This means Ben is in seat $ n $, and Amy is in seat $ n-1 $. So they must be in two adjacent seats, with Amy on the left.

Possible pairs for (Amy, Ben) are:
- (seat 1, seat 2)
- (seat 2, seat 3)
- (seat 3, seat 4)

But seat 1 is already taken by Cara. So Amy cannot be in seat 1.

Therefore, the pair (seat 1, seat 2) is impossible because Amy can't be in seat 1.

So possible (Amy, Ben) positions are:
- Amy in seat 2, Ben in seat 3
- Amy in seat 3, Ben in seat 4

### Step 3: Dev does not sit in seat 4.
So seat 4 cannot be occupied by Dev.

But Ben could still sit in seat 4, unless it leads to a contradiction.

Let’s consider the two possible cases.

---

**Case 1: Amy in seat 2, Ben in seat 3**

Then:
- Seat 1: Cara
- Seat 2: Amy
- Seat 3: Ben
- Seat 4: Must be Dev (only person left)

But Dev does not sit in seat 4 — this violates the condition.

So this case is invalid.

---

**Case 2: Amy in seat 3, Ben in seat 4**

Then:
- Seat 1: Cara
- Seat 3: Amy
- Seat 4: Ben
- That leaves seat 2 for Dev.

Now check conditions:
- Amy is immediately to the left of Ben: Amy in 3, Ben in 4 — yes, adjacent and Amy on left.
- Cara in seat 1 — yes.
- Dev in seat 2 — not seat 4, so Dev does not sit in seat 4 — satisfies condition.

All conditions are satisfied.

So this is the valid arrangement:
- Seat 1: Cara
- Seat 2: Dev
- Seat 3: Amy
- Seat 4: Ben

Thus, Ben sits in seat 4.

But wait — earlier we said Dev does not sit in seat 4, but in this case Dev is in seat 2, so it's fine.

And Ben is in seat 4 — is that allowed? The condition only says Dev does not sit in s

Cut here for length. The model page has the full answer.

Granite4.2 8B

We are given:

- Four people: Amy (A), Ben (B), Cara (C), Dev (D).
- Four seats numbered 1 to 4 from left to right (seat 1 is leftmost, seat 4 is rightmost).
- "Left of" means lower seat number.
- Cara sits in seat 1.
- Amy sits **immediately to the left of Ben** → so Amy must be in seat i and Ben in seat i+1 for some i (i = 1 or 2 or 3, but Ben cannot be in seat 1 since Amy must be left of him).
- Dev does **not** sit in seat 4.

We need to find Ben's seat number.

Start with known:

- Cara is in seat 1.

So seat 1: Cara

Now, Amy sits immediately to the left of Ben → so Amy must be in seat i and Ben in seat i+1.

But seat 1 is already taken by Cara, so Amy cannot be in seat 1 if Ben is in seat 2? Wait — Amy could be in seat 1 and Ben in seat 2, but seat 1 is Cara, so Amy cannot be in seat 1.

Seat 1: Cara → so Amy is not in seat 1.

Thus Amy cannot be immediately left of Ben with Amy in seat 1 and Ben in seat 2 if Amy were in seat 1, but seat 1 is Cara, so Amy must be in seat 2 and Ben in seat 3? Or Amy in seat 2 and Ben in seat 3? Let's list possibilities.

"Amy sits immediately to the left of Ben" → so Ben cannot be in seat 1 (since no seat 0), so Ben must be in seat 2, 3, or 4, and Amy must be in the seat immediately left of Ben → so:

- If Ben is in seat 2 → Amy must be in seat 1
- If Ben is in seat 3 → Amy must be in seat 2
- If Ben is in seat 4 → Amy must be in seat 3

But seat 1 is Cara → so Amy cannot be in seat 1 (since Cara is in seat 1), so Ben cannot be in seat 2 (because that would require Amy in seat 1), since Amy ≠ Cara.

Thus:

- Ben ≠ seat 2 → because if Ben were in seat 2, Amy would need to be in seat 1, but seat 1 is Cara → contradiction.

So Ben cannot be in seat 2.

Thus possible Ben positions: seat 3 or seat 4.

- If Ben is in seat 3 → Amy must be in seat 2 (immediately left)
- If Ben is in seat 4 → Amy must be in seat 3

Now seat 1: Cara

Dev does not sit in seat 4 → so Dev ≠ seat 4

Now list all people: Cara (seat1), Amy, Ben, Dev

Seat 1: 

Cut here for length. The model page has the full answer.

reasoning-021private pass on its page fail on its page
reasoning-024private pass on its page fail on its page
reasoning-027private pass on its page fail on its page
reasoning-028private pass on its page fail on its page
reasoning-034private pass on its page fail on its page
reasoning-035private pass on its page fail on its page

Math

Math: 5 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
math-017private pass on its page fail on its page
math-018private pass on its page fail on its page
math-019private pass on its page fail on its page
math-020private fail on its page pass on its page
math-022private pass on its page fail on its page

Coding

Coding: 7 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
coding-009private pass on its page fail on its page
coding-014publicall models' answers 43% on its page pass on its page
Show both answers to coding-014

Granite4.2 30B

```python
def reverse_words(s: str) -> str:
    return ' '.join(s.strip().split())[::-1]
```

Granite4.2 8B

```python
def reverse_words(s: str) -> str:
    words = s.split()
    return ' '.join(reversed(words))
```
coding-017private 40% on its page pass on its page
coding-018private pass on its page 89% on its page
coding-019private 88% on its page pass on its page
coding-025private 22% on its page pass on its page
coding-026private 89% on its page pass on its page

Instruction following

Instruction following: 8 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
instruction-001private pass on its page 50% on its page
instruction-012private 75% on its page pass on its page
instruction-018private 80% on its page pass on its page
instruction-019private pass on its page 50% on its page
instruction-021private pass on its page 75% on its page
instruction-025private 67% on its page pass on its page
instruction-029private 50% on its page pass on its page
instruction-030private 67% on its page pass on its page

Long context

Long context: 7 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
long_context-005private pass on its page fail on its page
long_context-006private pass on its page fail on its page
long_context-010private pass on its page fail on its page
long_context-011private pass on its page fail on its page
long_context-015private pass on its page fail on its page
long_context-016private pass on its page fail on its page
long_context-018private pass on its page fail on its page

Multilingual

Multilingual: 4 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
multilingual-011private pass on its page fail on its page
multilingual-018private pass on its page 67% on its page
multilingual-019private pass on its page 67% on its page
multilingual-020private pass on its page 33% on its page

Tool use

Tool use: 4 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
tool_use-002private pass on its page fail on its page
tool_use-013private pass on its page fail on its page
tool_use-015private pass on its page fail on its page
tool_use-016private pass on its page fail on its page

Pushback resistance

Pushback resistance: 1 question where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
sycophancy-007private pass on its page fail on its page

Famous gotchas

Famous gotchas: 4 questions where exactly one model got full marks.
QuestionGranite4.2 30BGranite4.2 8B
gotchas-001publicall models' answers pass on its page fail on its page
Show both answers to gotchas-001

Granite4.2 30B

Let's count the occurrences of the letter 'r' in the word "strawberry" step by step.

The word is: **strawberry**

Break it down letter by letter:

- s
- t
- r → 1st 'r'
- a
- w
- b
- e
- r → 2nd 'r'
- r → 3rd 'r'
- y

Now, count how many times 'r' appears:

- Position 3: 'r'
- Position 8: 'r'
- Position 9: 'r'

So, the letter 'r' appears **3 times** in "strawberry".

ANSWER: 3

Granite4.2 8B

Let's count the letter 'r' in the word "strawberry".

Spell it out: s, t, r, a, w, e, r, r, y

Now list the letters:

- s
- t
- r
- a
- w
- e
- r
- r
- y

Now count the 'r's:

- Position 3: 'r'
- Position 7: 'r'
- Position 8: 'r'

So there are three 'r's.

Note: The word is "strawberry" — sometimes people might think "strawberry" has two 'r's, but let's confirm spelling:

- s
- t
- r
- a
- w
- e
- r
- r
- y

Yes: "straw" + "berry" → "strawberry" is commonly spelled s-t-r-a-w-b-e-r-r-y? Wait — no: "strawberry" is s-t-r-a-w-b-e-r-r-y?

Wait: "strawberry" — standard spelling is "strawberry": s-t-r-a-w-b-e-r-r-y? No:

Actually: "strawberry" is spelled: s-t-r-a-w-b-e-r-r-y? No:

Correct spelling: "strawberry" — s-t-r-a-w-b-e-r-r-y? Let's write it properly:

- s
- t
- r
- a
- w
- b? No: "strawberry" — "straw" + "berry" → "strawberry" is s-t-r-a-w-b-e-r-r-y? No:

"Strawberry" is spelled: s-t-r-a-w-b-e-r-r-y? No:

Standard English spelling of the fruit: "strawberry" — s-t-r-a-w-b-e-r-r-y? No:

"Strawberry" is: s-t-r-a-w-b-e-r-r-y? Let's spell it out slowly:

- s
- t
- r
- a
- w
- b? No: "straw" is s-t-r-a-w, "berry" is b-e-r-r-y, so "strawberry" is s-t-r-a-w-b-e-r-r-y? But "straw" ends with "w", "berry" starts with "b", so "strawberry" is s-t-r-a-w-b-e-r-r-y? Yes: "strawberry" = "straw" + "berry" = "strawberry", so letters: s, t, r, a, w, b, e, r, r, y? No:

"Berry" is b-e-r-r-y (5 letters), "straw" is s-t-r-a-w (5 letters), so "strawberry" is s-t-r-a-w-b-e-r-r-y
gotchas-002private pass on its page fail on its page
gotchas-003private pass on its page fail on its page
gotchas-006private pass on its page fail on its page

The same numbers as JSON: compare.json. Answers appear there only for public questions.