Can you run Qwen 3.5 4B on RTX 4090?
Short answer
Yes — Qwen 3.5 4B fits in RTX 4090 with 20.3 GB of VRAM to spare.
- Model file
- 2.6 GB
- Needs in VRAM, with context
- about 3.7 GB
- Card memory
- 24 GB
- Measured on this hardware
- not measured
How this was worked out
Qwen 3.5 4B is a 2.6 GB file. Running it needs the weights in memory plus room for the context window and the runtime, which comes to roughly 3.7 GB in practice. RTX 4090 has 24 GB, which leaves 20.3 GB. That is arithmetic rather than a benchmark: it tells you whether the model loads, not how it feels.
What we have actually measured
We have not timed Qwen 3.5 4B on RTX 4090. The closest figure we have is no measurement of this model at all yet. Rather than scale that number to your card and present the result as a benchmark, this page leaves it out. The method is published at /benchmarks if you would like to run it yourself.
If it is tight
There is room to spare, so the thing to watch is what else is using the card. Close anything doing 3D or video encoding before you judge the speed. Nightjar sizes the context window to the memory it finds, so a smaller card gets a shorter window rather than a failed load.
Smaller models that fit the same card
- Llama 3.2 1B on RTX 4090 — 0.75 GB
- Qwen 3.5 2B on RTX 4090 — 1.2 GB
Related
- Up a levelCan your PC run a local AI model?
- Closely relatedCan you run Gemma 4 12B-it on RTX 4090?
- Closely relatedCan you run Gemma 4 26B-A4B-it on RTX 4090?
- Closely relatedCan you run Gemma 4 31B-it on RTX 4090?
- Closely relatedCan you run Gemma 4 E2B-it on RTX 4090?
- Elsewhere on the siteLocal AI on RTX 4090: which models run and how fast
- Elsewhere on the siteQwen 3.5 4B in Nightjar: speed, size and what it is good at