Nemotron 3.5 Lightning vs Gemma 4 26B A4B
Too close to call. On the work we tested, Nemotron 3.5 Lightning and Gemma 4 26B A4B can't be told apart. Gemma 4 26B A4B is the cheaper one, by 6.4×.
GrindBench-PubSec
DNemotron 3.5 LightningNVIDIA23% 19–28%0.19¢ a task · 300 tasksFGemma 4 26B A4BGoogle17% 13–21%0.027¢ a task · 300 tasks
Too close to call here: their ranges overlap, so on another set of tasks the order could flip.
| Kind of work | Nemotron 3.5 Lightning | Gemma 4 26B A4B |
|---|---|---|
| ATIP redaction | 0% | 0% |
| Procurement evaluation | 42% | 2% |
| Performance analysis | 16% | 0% |
| Bilingual equivalence | 42% | 85% |
GrindBench-Banking
FNemotron 3.5 LightningNVIDIA2% 0–5%0.87¢ a task · 60 tasksFGemma 4 26B A4BGoogle0% 0–0%0.14¢ a task · 60 tasks
Too close to call here: their ranges overlap, so on another set of tasks the order could flip.
| Kind of work | Nemotron 3.5 Lightning | Gemma 4 26B A4B |
|---|---|---|
| Lending & mortgages | 10% | 0% |
| AML & KYC | 0% | 0% |
| Deposits & payments | 0% | 0% |
| Complaints & conduct | 0% | 0% |
| Credit risk | 0% | 0% |
| Capital & liquidity | 0% | 0% |
Each kind of work here rests on 10 tasks per model, so a single row can easily be 20 points off. A lead of 10 points or more is in bold; read it as a hint, not a result.