gpt-oss-120b

120B parameters
reasoningcoding
Parameters
120B
Context Length
32K
Architecture
gpt
Release Date
2025

Available Quantizations

QuantizationFile SizeQuality
Q8_0128.0 GBHigh
Q6_K99.0 GBHigh
Q5_K_M87.0 GBGood
Q4_K_M73.0 GBGood
Q3_K_M62.0 GBLower

Can it run? (Q4_K_M quantization)

GeForce RTX 4090
Won't run
~0 tok/s • 24GB VRAM
GeForce RTX 4070
Won't run
~0 tok/s • 12GB VRAM
GeForce RTX 3060 12GB
Won't run
~0 tok/s • 12GB VRAM
Radeon RX 7900 XTX
Won't run
~0 tok/s • 24GB VRAM
Check with your specific GPU →