Skip to content

Qwen 3.5 2B in Nightjar: speed, size and what it is good at

Short answer

Qwen 3.5 2B is a 1.2 GB download that runs inside Nightjar on your own hardware. It scored 16 out of 16 on our evaluation set and generated 65 tokens per second on RTX 3060 12 GB, Vulkan backend.

Download
1.2 GB
Reads images
yes
On our test card
65 tokens/sec
CPU only
15 tokens/sec

Fastest thing here that still answers well. Scored full marks on our 16-question set at a fifth of the size of the models that tied it.

What it needs

Budget about 2.3 GB of memory for the weights plus context. We would not run this one below 4 GB of system RAM. It works on the CPU, but see the figure above before deciding that is good enough.

Which cards run it

Pick your card from the hardware index for the arithmetic on that exact configuration.

Other ways people ask this

  • qwen 3.5 2b requirements
  • qwen 3.5 2b vram
  • qwen 3.5 2b gguf download
  • is Qwen 3.5 2B good enough for summarising web pages?

Related