Qwen 3 30B-A3B

30.5B parametersMoE
reasoningcodingmultilingualmoe
Parameters
30.5B
3.3B active
Context Length
128K
Architecture
qwen2moe
Release Date
2025

Available Quantizations

QuantizationFile SizeQuality
Q8_032.5 GBHigh
Q6_K25.2 GBHigh
Q5_K_M22.1 GBGood
Q4_K_M18.6 GBGood
Q3_K_M15.8 GBLower

Can it run? (Q4_K_M quantization)

GeForce RTX 4090
Runs great
~106 tok/s • 24GB VRAM
GeForce RTX 4070
Runs slowly
~11 tok/s • 12GB VRAM
GeForce RTX 3060 12GB
Runs slowly
~8 tok/s • 12GB VRAM
Radeon RX 7900 XTX
Runs great
~101 tok/s • 24GB VRAM
Check with your specific GPU →