Gemma 4 12B-it in Nightjar: speed, size and what it is good at
Short answer
Gemma 4 12B-it is a 6.6 GB download that runs inside Nightjar on your own hardware. It scored 16 out of 16 on our evaluation set and generated 24 tokens per second on RTX 3060 12 GB, Vulkan backend.
- Download
- 6.6 GB
- Reads images
- yes
- On our test card
- 24 tokens/sec
- CPU only
- 2.8 tokens/sec
The most capable of the everyday models. Full marks on the evaluation, and it will use every gigabyte of VRAM you have.
What it needs
Budget about 7.7 GB of memory for the weights plus context. We would not run this one below 16 GB of system RAM. It works on the CPU, but see the figure above before deciding that is good enough.
Which cards run it
Pick your card from the hardware index for the arithmetic on that exact configuration.
Other ways people ask this
- gemma 4 12b-it requirements
- gemma 4 12b-it vram
- gemma 4 12b-it gguf download
- is Gemma 4 12B-it good enough for summarising web pages?