Skip to content

Llama 3.2 1B in Nightjar: speed, size and what it is good at

Short answer

Llama 3.2 1B is a 0.75 GB download that runs inside Nightjar on your own hardware. It scored 10 out of 16 on our evaluation set.

Download
0.75 GB
Reads images
no
On our test card
not measured
CPU only
not measured

The one that runs on anything. Answers short questions about the page you are on and little else.

What it needs

Budget about 1.9 GB of memory for the weights plus context. We would not run this one below 4 GB of system RAM. It works on the CPU, but see the figure above before deciding that is good enough.

Which cards run it

Pick your card from the hardware index for the arithmetic on that exact configuration.

Other ways people ask this

  • llama 3.2 1b requirements
  • llama 3.2 1b vram
  • llama 3.2 1b gguf download
  • is Llama 3.2 1B good enough for summarising web pages?

Related