Local AI on Intel Arc A770: which models run and how fast
Short answer
Intel Arc A770 has 16 GB of video memory, which holds 7 of Nightjar's eleven models entirely, the largest being Gemma 4 12B-it.
- Video memory
- 16 GB
- Models that fit fully
- 7 of 11
- Largest that fits
- Gemma 4 12B-it
- This is our test card
- no
Every model against this card
- Llama 3.2 1B — 0.75 GB, fits with 14.2 GB spare
- Qwen 3.5 2B — 1.2 GB, fits with 13.7 GB spare
- Qwen 3.5 4B — 2.6 GB, fits with 12.3 GB spare
- Gemma 4 E2B-it — 3.2 GB, fits with 11.7 GB spare
- Gemma 4 E4B-it — 5 GB, fits with 9.9 GB spare
- Qwen 3.5 9B — 5.3 GB, fits with 9.6 GB spare
- Gemma 4 12B-it — 6.6 GB, fits with 8.3 GB spare
- Gemma 4 26B-A4B-it — 15.8 GB, needs CPU offload
- Qwen 3.5 27B — 15.6 GB, needs CPU offload
- Qwen 3.5 35B-A3B — 20.5 GB, needs CPU offload
- Gemma 4 31B-it — 30.4 GB, needs CPU offload
What the numbers here are and are not
The fit is arithmetic — a file size against a memory size, with about 1.1 GB added for context and runtime. The speeds elsewhere on this site were measured on RTX 3060 12 GB, Vulkan backend and nowhere else. Where a page says a figure was not measured, that is literal: we would rather leave a gap than publish an estimate that reads like a result.
Other ways people ask this
- best local llm for intel arc a770
- intel arc a770 llm tokens per second
- I have a Intel Arc A770. Which local model should I run for browser AI?