Can you run Qwen 3.5 35B-A3B on RTX 4080?
Short answer
Partly — Qwen 3.5 35B-A3B needs about 21.6 GB and RTX 4080 has 16 GB, so some layers run on the CPU.
- Model file
- 20.5 GB
- Needs in VRAM, with context
- about 21.6 GB
- Card memory
- 16 GB
- Measured on this hardware
- not measured
How this was worked out
Qwen 3.5 35B-A3B is a 20.5 GB file. Running it needs the weights in memory plus room for the context window and the runtime, which comes to roughly 21.6 GB in practice. RTX 4080 has 16 GB, which leaves -5.6 GB. That is arithmetic rather than a benchmark: it tells you whether the model loads, not how it feels.
What we have actually measured
We have not timed Qwen 3.5 35B-A3B on RTX 4080. The closest figure we have is no measurement of this model at all yet. Rather than scale that number to your card and present the result as a benchmark, this page leaves it out. The method is published at /benchmarks if you would like to run it yourself.
If it is tight
Nightjar will still load Qwen 3.5 35B-A3B on RTX 4080 by keeping some layers on the CPU, which works but costs speed. The next model down in the catalogue will fit entirely. Nightjar sizes the context window to the memory it finds, so a smaller card gets a shorter window rather than a failed load.
Smaller models that fit the same card
- Gemma 4 12B-it on RTX 4080 — 6.6 GB
- Gemma 4 26B-A4B-it on RTX 4080 — 15.8 GB
- Qwen 3.5 27B on RTX 4080 — 15.6 GB
Related
- Up a levelCan your PC run a local AI model?
- Closely relatedCan you run Gemma 4 12B-it on RTX 4080?
- Closely relatedCan you run Gemma 4 26B-A4B-it on RTX 4080?
- Closely relatedCan you run Gemma 4 31B-it on RTX 4080?
- Closely relatedCan you run Gemma 4 E2B-it on RTX 4080?
- Elsewhere on the siteLocal AI on RTX 4080: which models run and how fast
- Elsewhere on the siteQwen 3.5 35B-A3B in Nightjar: speed, size and what it is good at