Choose GPU, CPU or a mix
Short answer
Nightjar runs models through Vulkan on the GPU, on the CPU, or split between them — because your machine is not the one in the review.
The problem it exists for
Published benchmarks are run on somebody else's hardware. Yours has a different card, a different driver and something else already using the VRAM.
How it works
- Vulkan is the default backend: about 32 MB, and it works on AMD, Intel and NVIDIA alike.
- Layers that do not fit in VRAM run on the CPU, so a model that is slightly too large still runs.
- CPU-only is a supported configuration, not a failure state — Qwen 3.5 2B managed 15 tokens per second with no GPU.
What it does not do
- Vulkan measured about 16% slower than CUDA on a 7B model, which is the price of working everywhere.
- Partial offload is much slower than fitting entirely in VRAM.
- Vulkan support comes from the graphics driver, so an old OEM driver can mean no GPU at all.
Other ways people ask this
- browser gpu, cpu or hybrid