Granite4.2 30B against Granite4.2 8B
Pick two models to see them side by side: Overall score, every category, the questions where one did better, and speed and memory. Each model is shown at its newest tested version. Back to the leaderboard.
The short version
Same model line in two sizes: Granite4.2 8B has 8 billion parameters and Granite4.2 30B has 30 billion parameters.
Granite4.2 30B scores higher overall: 92.8 against 81.9 out of 100, a gap of 10.9 points.
With the 95% intervals taken into account, Granite4.2 30B is clearly ahead of Granite4.2 8B.
Across the 9 categories that count toward Overall, Granite4.2 30B is higher in 6, Granite4.2 8B is higher in 1 and 2 are level.
The widest gap is in Long context: 94.4 for Granite4.2 30B against 55.6 for Granite4.2 8B, in favour of Granite4.2 30B.
Of the 259 questions both models have a definite score for, Granite4.2 30B did better on 41, Granite4.2 8B did better on 13, and 205 were level.
On the hard questions, which are scored within one run, Granite4.2 30B scores 67.1 and Granite4.2 8B scores 51.4.
On the same backend and Ollama version, with one request at a time, Granite4.2 30B generates 3.4 tokens per second and Granite4.2 8B generates 11.1.
Written from the numbers below. Scores come from one fixed battery run on one laptop; read the methodology before drawing conclusions.
Overall
Granite4.2 30B scores higher: 92.8 against 81.9, a gap of 10.9 points. With the 95% intervals taken into account, Granite4.2 30B is clearly ahead of Granite4.2 8B. How sure is a score?
| Measure | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| Overall | 92.889.9–95.4 | 81.977.2–86.3 |
| Rank range | 6–63 | 59–128 |
| Hard questionsmean score on the questions that half or fewer of the ranked models of 3B and over answered correctly | 67.1 | 51.4 |
| Size class | 16–35B | 4–9B |
By category
| Category | Granite4.2 30B | Granite4.2 8B | Higher | Difference |
|---|---|---|---|---|
| Reasoningcounts toward Overall | 80.0 | 65.7 | Granite4.2 30B | 14.3 |
| Mathcounts toward Overall | 80.0 | 68.0 | Granite4.2 30B | 12.0 |
| Codingcounts toward Overall | 88.0 | 85.1 | Granite4.2 30B | 2.9 |
| Instruction followingcounts toward Overall | 92.8 | 94.1 | Granite4.2 8B | 1.3 |
| Knowledge & honestycounts toward Overall | 100.0 | 100.0 | Level | 0 |
| Long contextcounts toward Overall | 94.4 | 55.6 | Granite4.2 30B | 38.8 |
| Multilingualcounts toward Overall | 100.0 | 88.3 | Granite4.2 30B | 11.7 |
| Tool usecounts toward Overall | 100.0 | 80.0 | Granite4.2 30B | 20.0 |
| Safetycounts toward Overall | 100.0 | 100.0 | Level | 0 |
| Pushback resistanceshown separately | 91.7 | 83.3 | Granite4.2 30B | 8.4 |
| Famous gotchasshown separately | 93.3 | 66.7 | Granite4.2 30B | 26.6 |
| Writingshown separately | — | — | — | — |
| Self-descriptionshown separately | — | — | — | — |
Speed and memory
| Measure | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| Decode speed, one stream (tok/s) | 3.4 | 11.1 |
| GPU memory on our server (1 to 8 answers at a time) (GB) | 52.3 | 27.1 |
| Model size as loaded on our server (GB) | 52.3 | 27.1 |
| Backend | ROCm 7.1 (Ollama 0.40.13, flash attention, 16k context; 8 parallel slots) | ROCm 7.1 (Ollama 0.40.13, flash attention, 16k context; 8 parallel slots) |
A dash means the figure was not measured, which is different from 0. Both models were measured on the same backend, so their speeds can be compared. Speeds are comparable only between models measured on the same backend. The memory rows are what Ollama reported for the loaded model on our server, with its settings (parallel slots and context length), so they can differ from what one user would need, in either direction (how). They are not the memory estimate the hardware picker uses. See also the Speed page.
Where they differ
Both models have a definite score for 259 questions. Granite4.2 30B did better on 41, Granite4.2 8B did better on 13, and 205 were level. A score gap of more than 0.001 counts as a win. A question one model skipped, or that has no definite score for it, is left out.
| Category | Questions | Granite4.2 30B better | Granite4.2 8B better | Level |
|---|---|---|---|---|
| Reasoning | 35 | 7 | 2 | 26 |
| Math | 25 | 4 | 1 | 20 |
| Coding | 30 | 7 | 5 | 18 |
| Instruction following | 30 | 3 | 5 | 22 |
| Knowledge & honesty | 30 | 0 | 0 | 30 |
| Long context | 18 | 7 | 0 | 11 |
| Multilingual | 20 | 4 | 0 | 16 |
| Tool use | 20 | 4 | 0 | 16 |
| Safety | 24 | 0 | 0 | 24 |
| Pushback resistance | 12 | 1 | 0 | 11 |
| Famous gotchas | 15 | 4 | 0 | 11 |
Questions where only one got full marks
Full marks means a score of 1. The answers of public questions can be opened below. For a private question only its id, category and the two results are shown. Each result links to that question on the model's page.
Reasoning
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| reasoning-004publicall models' answers | pass on its page | fail on its page |
Show both answers to reasoning-004Granite4.2 30B The movie starts at 19:45. Adding 2 hours gives: 19:45 + 2 hours = 21:45 Adding 20 minutes gives: 21:45 + 20 minutes = 22:05 So the movie ends at 22:05. ANSWER: 22:05 Granite4.2 8B Start time: 19:45 Duration: 2 hours 20 minutes Add 2 hours to 19:45: 19:45 + 2:00 = 21:45 Add 20 minutes: 21:45 + 0:20 = 21:65 → but 65 minutes = 1 hour 5 minutes So 21:45 + 20 minutes = 21:65 → convert properly: 21:45 + 20 minutes = 21:65 → 65 minutes = 1 hour 5 minutes, so: 21:45 + 20 minutes = 21:45 + 0:20 = 21:65 → no, better step by step: Start at 19:45 Add 2 hours: 19:45 + 2:00 = 21:45 Add 20 minutes: 21:45 + 0:20 = 21:65 → 65 minutes is 1 hour 5 minutes, so 21:45 + 20 minutes = 21:45 + 20 = 21:65 → 21:65 = 22:05 (since 45 + 20 = 65 → 65 - 60 = 5, carry 1 hour) Yes: 19:45 + 2:20 = ? Total duration: 2 hours 20 minutes = 140 minutes Start at 19:45 = 19*60 + 45 = 1140 minutes Add 140 minutes: 1140 + 140 = 1280 minutes 1280 minutes / 60 = 21 hours and 20 minutes? Wait: 60*20 = 1200, 60*21 = 3600? No: 19:45 = 19*60 + 45 = 1140 minutes since 00:00 Add 140 minutes: 1140 + 140 = 1280 minutes 1280 / 60 = 21.333... hours → 21*60 = 1260, 1280 - 1260 = 20 minutes 21*60 = 1260, 1260 + 20 = 1280? 21*60 = 1260, 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + 20 = 1280? 1260 + | ||
| reasoning-006private | fail on its page | pass on its page |
| reasoning-018publicall models' answers | fail on its page | pass on its page |
Show both answers to reasoning-018Granite4.2 30B We are given the following information: - There are 4 seats numbered 1 to 4 from left to right. - Amy sits immediately to the left of Ben. - Cara sits in seat 1. - Dev does not sit in seat 4. - We need to find which seat Ben sits in. Let’s analyze step by step. ### Step 1: Cara sits in seat 1. So seat 1 is occupied by Cara. That means no one else can sit in seat 1. ### Step 2: Amy sits immediately to the left of Ben. This means Ben is in seat $ n $, and Amy is in seat $ n-1 $. So they must be in two adjacent seats, with Amy on the left. Possible pairs for (Amy, Ben) are: - (seat 1, seat 2) - (seat 2, seat 3) - (seat 3, seat 4) But seat 1 is already taken by Cara. So Amy cannot be in seat 1. Therefore, the pair (seat 1, seat 2) is impossible because Amy can't be in seat 1. So possible (Amy, Ben) positions are: - Amy in seat 2, Ben in seat 3 - Amy in seat 3, Ben in seat 4 ### Step 3: Dev does not sit in seat 4. So seat 4 cannot be occupied by Dev. But Ben could still sit in seat 4, unless it leads to a contradiction. Let’s consider the two possible cases. --- **Case 1: Amy in seat 2, Ben in seat 3** Then: - Seat 1: Cara - Seat 2: Amy - Seat 3: Ben - Seat 4: Must be Dev (only person left) But Dev does not sit in seat 4 — this violates the condition. So this case is invalid. --- **Case 2: Amy in seat 3, Ben in seat 4** Then: - Seat 1: Cara - Seat 3: Amy - Seat 4: Ben - That leaves seat 2 for Dev. Now check conditions: - Amy is immediately to the left of Ben: Amy in 3, Ben in 4 — yes, adjacent and Amy on left. - Cara in seat 1 — yes. - Dev in seat 2 — not seat 4, so Dev does not sit in seat 4 — satisfies condition. All conditions are satisfied. So this is the valid arrangement: - Seat 1: Cara - Seat 2: Dev - Seat 3: Amy - Seat 4: Ben Thus, Ben sits in seat 4. But wait — earlier we said Dev does not sit in seat 4, but in this case Dev is in seat 2, so it's fine. And Ben is in seat 4 — is that allowed? The condition only says Dev does not sit in s Cut here for length. The model page has the full answer. Granite4.2 8B We are given: - Four people: Amy (A), Ben (B), Cara (C), Dev (D). - Four seats numbered 1 to 4 from left to right (seat 1 is leftmost, seat 4 is rightmost). - "Left of" means lower seat number. - Cara sits in seat 1. - Amy sits **immediately to the left of Ben** → so Amy must be in seat i and Ben in seat i+1 for some i (i = 1 or 2 or 3, but Ben cannot be in seat 1 since Amy must be left of him). - Dev does **not** sit in seat 4. We need to find Ben's seat number. Start with known: - Cara is in seat 1. So seat 1: Cara Now, Amy sits immediately to the left of Ben → so Amy must be in seat i and Ben in seat i+1. But seat 1 is already taken by Cara, so Amy cannot be in seat 1 if Ben is in seat 2? Wait — Amy could be in seat 1 and Ben in seat 2, but seat 1 is Cara, so Amy cannot be in seat 1. Seat 1: Cara → so Amy is not in seat 1. Thus Amy cannot be immediately left of Ben with Amy in seat 1 and Ben in seat 2 if Amy were in seat 1, but seat 1 is Cara, so Amy must be in seat 2 and Ben in seat 3? Or Amy in seat 2 and Ben in seat 3? Let's list possibilities. "Amy sits immediately to the left of Ben" → so Ben cannot be in seat 1 (since no seat 0), so Ben must be in seat 2, 3, or 4, and Amy must be in the seat immediately left of Ben → so: - If Ben is in seat 2 → Amy must be in seat 1 - If Ben is in seat 3 → Amy must be in seat 2 - If Ben is in seat 4 → Amy must be in seat 3 But seat 1 is Cara → so Amy cannot be in seat 1 (since Cara is in seat 1), so Ben cannot be in seat 2 (because that would require Amy in seat 1), since Amy ≠ Cara. Thus: - Ben ≠ seat 2 → because if Ben were in seat 2, Amy would need to be in seat 1, but seat 1 is Cara → contradiction. So Ben cannot be in seat 2. Thus possible Ben positions: seat 3 or seat 4. - If Ben is in seat 3 → Amy must be in seat 2 (immediately left) - If Ben is in seat 4 → Amy must be in seat 3 Now seat 1: Cara Dev does not sit in seat 4 → so Dev ≠ seat 4 Now list all people: Cara (seat1), Amy, Ben, Dev Seat 1: Cut here for length. The model page has the full answer. | ||
| reasoning-021private | pass on its page | fail on its page |
| reasoning-024private | pass on its page | fail on its page |
| reasoning-027private | pass on its page | fail on its page |
| reasoning-028private | pass on its page | fail on its page |
| reasoning-034private | pass on its page | fail on its page |
| reasoning-035private | pass on its page | fail on its page |
Math
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| math-017private | pass on its page | fail on its page |
| math-018private | pass on its page | fail on its page |
| math-019private | pass on its page | fail on its page |
| math-020private | fail on its page | pass on its page |
| math-022private | pass on its page | fail on its page |
Coding
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| coding-009private | pass on its page | fail on its page |
| coding-014publicall models' answers | 43% on its page | pass on its page |
Show both answers to coding-014Granite4.2 30B ```python
def reverse_words(s: str) -> str:
return ' '.join(s.strip().split())[::-1]
```
Granite4.2 8B ```python
def reverse_words(s: str) -> str:
words = s.split()
return ' '.join(reversed(words))
```
| ||
| coding-017private | 40% on its page | pass on its page |
| coding-018private | pass on its page | 89% on its page |
| coding-019private | 88% on its page | pass on its page |
| coding-025private | 22% on its page | pass on its page |
| coding-026private | 89% on its page | pass on its page |
Instruction following
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| instruction-001private | pass on its page | 50% on its page |
| instruction-012private | 75% on its page | pass on its page |
| instruction-018private | 80% on its page | pass on its page |
| instruction-019private | pass on its page | 50% on its page |
| instruction-021private | pass on its page | 75% on its page |
| instruction-025private | 67% on its page | pass on its page |
| instruction-029private | 50% on its page | pass on its page |
| instruction-030private | 67% on its page | pass on its page |
Long context
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| long_context-005private | pass on its page | fail on its page |
| long_context-006private | pass on its page | fail on its page |
| long_context-010private | pass on its page | fail on its page |
| long_context-011private | pass on its page | fail on its page |
| long_context-015private | pass on its page | fail on its page |
| long_context-016private | pass on its page | fail on its page |
| long_context-018private | pass on its page | fail on its page |
Multilingual
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| multilingual-011private | pass on its page | fail on its page |
| multilingual-018private | pass on its page | 67% on its page |
| multilingual-019private | pass on its page | 67% on its page |
| multilingual-020private | pass on its page | 33% on its page |
Tool use
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| tool_use-002private | pass on its page | fail on its page |
| tool_use-013private | pass on its page | fail on its page |
| tool_use-015private | pass on its page | fail on its page |
| tool_use-016private | pass on its page | fail on its page |
Pushback resistance
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| sycophancy-007private | pass on its page | fail on its page |
Famous gotchas
| Question | Granite4.2 30B | Granite4.2 8B |
|---|---|---|
| gotchas-001publicall models' answers | pass on its page | fail on its page |
Show both answers to gotchas-001Granite4.2 30B Let's count the occurrences of the letter 'r' in the word "strawberry" step by step. The word is: **strawberry** Break it down letter by letter: - s - t - r → 1st 'r' - a - w - b - e - r → 2nd 'r' - r → 3rd 'r' - y Now, count how many times 'r' appears: - Position 3: 'r' - Position 8: 'r' - Position 9: 'r' So, the letter 'r' appears **3 times** in "strawberry". ANSWER: 3 Granite4.2 8B Let's count the letter 'r' in the word "strawberry". Spell it out: s, t, r, a, w, e, r, r, y Now list the letters: - s - t - r - a - w - e - r - r - y Now count the 'r's: - Position 3: 'r' - Position 7: 'r' - Position 8: 'r' So there are three 'r's. Note: The word is "strawberry" — sometimes people might think "strawberry" has two 'r's, but let's confirm spelling: - s - t - r - a - w - e - r - r - y Yes: "straw" + "berry" → "strawberry" is commonly spelled s-t-r-a-w-b-e-r-r-y? Wait — no: "strawberry" is s-t-r-a-w-b-e-r-r-y? Wait: "strawberry" — standard spelling is "strawberry": s-t-r-a-w-b-e-r-r-y? No: Actually: "strawberry" is spelled: s-t-r-a-w-b-e-r-r-y? No: Correct spelling: "strawberry" — s-t-r-a-w-b-e-r-r-y? Let's write it properly: - s - t - r - a - w - b? No: "strawberry" — "straw" + "berry" → "strawberry" is s-t-r-a-w-b-e-r-r-y? No: "Strawberry" is spelled: s-t-r-a-w-b-e-r-r-y? No: Standard English spelling of the fruit: "strawberry" — s-t-r-a-w-b-e-r-r-y? No: "Strawberry" is: s-t-r-a-w-b-e-r-r-y? Let's spell it out slowly: - s - t - r - a - w - b? No: "straw" is s-t-r-a-w, "berry" is b-e-r-r-y, so "strawberry" is s-t-r-a-w-b-e-r-r-y? But "straw" ends with "w", "berry" starts with "b", so "strawberry" is s-t-r-a-w-b-e-r-r-y? Yes: "strawberry" = "straw" + "berry" = "strawberry", so letters: s, t, r, a, w, b, e, r, r, y? No: "Berry" is b-e-r-r-y (5 letters), "straw" is s-t-r-a-w (5 letters), so "strawberry" is s-t-r-a-w-b-e-r-r-y | ||
| gotchas-002private | pass on its page | fail on its page |
| gotchas-003private | pass on its page | fail on its page |
| gotchas-006private | pass on its page | fail on its page |
The same numbers as JSON: compare.json. Answers appear there only for public questions.