~/model/huggingfaceQwen/Qwen3.5-9B
Alibaba provider

Qwen 3.5 9B

Q1 2026 Qwen3.5 dense. The new sub-10B reference; vision-capable variants ship under the same family.

Parameters
9B
Family
Alibaba
Context
128K tokens
FP16 weights
18GB
// where you can run it
OllamaLM StudiovLLMMLXoMLX
// hugging face stats (cached daily)
8.0M downloads · 1K likes · license: apache-2.0 · updated 2 months ago

What you need to run this.

$ ./vrambudget --model qwen-3-5-9b --by quant
FP1618 GB
RTX 309024 GB · fitsRTX 3090 Ti24 GB · fitsRTX 409024 GB · fitsRX 7900 XTX24 GB · fits
Q8_09.6 GB
RTX 4060 Ti 16GB16 GB · fitsRTX 4070 Ti Super16 GB · fitsRTX 408016 GB · fitsRTX 4080 Super16 GB · fits
Q6_K7.4 GB
RTX 3060 12GB12 GB · fitsRTX 3080 Ti12 GB · fitsRTX 407012 GB · fitsRTX 4070 Super12 GB · fits
Q5_K_M6.2 GB
RTX 308010 GB · fitsRTX 3060 12GB12 GB · fitsRTX 3080 Ti12 GB · fitsRTX 407012 GB · fits
Q4_K_M5.1 GB
RTX 30708 GB · fitsRTX 40608 GB · fitsRTX 308010 GB · fitsRTX 3060 12GB12 GB · fits

// budgets shown at ctx 8K, concurrency 1, 15% safety headroom. Tune in the calculator →

Alternatives at this size.

$ grep --params similar catalog.json
$ similarGemma 2 9B9BGoogle$ similarLlama 3.1 8B8BMeta$ similarGranite 8B Code8BIBM$ similarMistral 7B v0.37.2BMistral

Discussion.

$ gh discussion list

// sign in with github to leave a comment. threads live in the repo's discussions tab.