Skip to content

Can you run Gemma 4 26B-A4B-it on RTX 4060?

Short answer

Partly — Gemma 4 26B-A4B-it needs about 16.9 GB and RTX 4060 has 8 GB, so some layers run on the CPU.

Model file
15.8 GB
Needs in VRAM, with context
about 16.9 GB
Card memory
8 GB
Measured on this hardware
not measured

How this was worked out

Gemma 4 26B-A4B-it is a 15.8 GB file. Running it needs the weights in memory plus room for the context window and the runtime, which comes to roughly 16.9 GB in practice. RTX 4060 has 8 GB, which leaves -8.9 GB. That is arithmetic rather than a benchmark: it tells you whether the model loads, not how it feels.

What we have actually measured

We have not timed Gemma 4 26B-A4B-it on RTX 4060. The closest figure we have is no measurement of this model at all yet. Rather than scale that number to your card and present the result as a benchmark, this page leaves it out. The method is published at /benchmarks if you would like to run it yourself.

If it is tight

Nightjar will still load Gemma 4 26B-A4B-it on RTX 4060 by keeping some layers on the CPU, which works but costs speed. The next model down in the catalogue will fit entirely. Nightjar sizes the context window to the memory it finds, so a smaller card gets a shorter window rather than a failed load.

Smaller models that fit the same card

Related