Skip to content

Local AI on RTX 5070: which models run and how fast

Short answer

RTX 5070 has 12 GB of video memory, which holds 7 of Nightjar's eleven models entirely, the largest being Gemma 4 12B-it.

Video memory
12 GB
Models that fit fully
7 of 11
Largest that fits
Gemma 4 12B-it
This is our test card
no

Every model against this card

What the numbers here are and are not

The fit is arithmetic — a file size against a memory size, with about 1.1 GB added for context and runtime. The speeds elsewhere on this site were measured on RTX 3060 12 GB, Vulkan backend and nowhere else. Where a page says a figure was not measured, that is literal: we would rather leave a gap than publish an estimate that reads like a result.

Other ways people ask this

  • best local llm for rtx 5070
  • rtx 5070 llm tokens per second
  • I have a RTX 5070. Which local model should I run for browser AI?

Related