Can you run Gemma 4 31B-it on RTX 5090?
Short answer
Yes, but only just — Gemma 4 31B-it leaves 0.5 GB spare on RTX 5090.
- Model file
- 30.4 GB
- Needs in VRAM, with context
- about 31.5 GB
- Card memory
- 32 GB
- Measured on this hardware
- not measured
How this was worked out
Gemma 4 31B-it is a 30.4 GB file. Running it needs the weights in memory plus room for the context window and the runtime, which comes to roughly 31.5 GB in practice. RTX 5090 has 32 GB, which leaves 0.5 GB. That is arithmetic rather than a benchmark: it tells you whether the model loads, not how it feels.
What we have actually measured
We have not timed Gemma 4 31B-it on RTX 5090. The closest figure we have is no measurement of this model at all yet. Rather than scale that number to your card and present the result as a benchmark, this page leaves it out. The method is published at /benchmarks if you would like to run it yourself.
If it is tight
0.5 GB is not much of a margin. Your desktop compositor and anything with a video playing are competing for the same memory, so this one loads but can fall back to the CPU under pressure. If it stutters, drop to the next model down. Nightjar sizes the context window to the memory it finds, so a smaller card gets a shorter window rather than a failed load.
Smaller models that fit the same card
- Gemma 4 26B-A4B-it on RTX 5090 — 15.8 GB
- Qwen 3.5 27B on RTX 5090 — 15.6 GB
- Qwen 3.5 35B-A3B on RTX 5090 — 20.5 GB
Related
- Up a levelCan your PC run a local AI model?
- Closely relatedCan you run Gemma 4 12B-it on RTX 5090?
- Closely relatedCan you run Gemma 4 26B-A4B-it on RTX 5090?
- Closely relatedCan you run Gemma 4 31B-it on Intel Arc A770?
- Closely relatedCan you run Gemma 4 31B-it on Intel Arc B580?
- Elsewhere on the siteLocal AI on RTX 5090: which models run and how fast
- Elsewhere on the siteGemma 4 31B-it in Nightjar: speed, size and what it is good at