Skip to content

Vulkan

Short answer

Vulkan is a cross-vendor graphics and compute API. Nightjar uses it to run models on the GPU without needing a vendor-specific toolkit installed.

The practical argument for Vulkan is size and reach: the backend is about 32 MB against roughly 611 MB for CUDA, and it works on AMD, Intel and NVIDIA alike rather than NVIDIA only.

The cost is some speed. On a 7B model Vulkan measured about 16% slower than CUDA at generation, while on a small 1.5B model it came out roughly 4% faster. For a browser that has to install cleanly on whatever card is in the machine, that trade is worth making.

Related terms

Other ways people ask this

  • what is vulkan

Related