Skip to content

Choose GPU, CPU or a mix

Short answer

Nightjar runs models through Vulkan on the GPU, on the CPU, or split between them — because your machine is not the one in the review.

The problem it exists for

Published benchmarks are run on somebody else's hardware. Yours has a different card, a different driver and something else already using the VRAM.

How it works

  • Vulkan is the default backend: about 32 MB, and it works on AMD, Intel and NVIDIA alike.
  • Layers that do not fit in VRAM run on the CPU, so a model that is slightly too large still runs.
  • CPU-only is a supported configuration, not a failure state — Qwen 3.5 2B managed 15 tokens per second with no GPU.

What it does not do

  • Vulkan measured about 16% slower than CUDA on a 7B model, which is the price of working everywhere.
  • Partial offload is much slower than fitting entirely in VRAM.
  • Vulkan support comes from the graphics driver, so an old OEM driver can mean no GPU at all.

Other ways people ask this

  • browser gpu, cpu or hybrid

Related