Radeon RX 7900 XTX

Best local AI models for this GPU

VRAM
24 GB
Bandwidth
960 GB/s
Vendor
AMD
Compatible Models
24

How it compares

Radeon RX 7900 XTX vs GPUs at nearby launch prices. Estimates from memory bandwidth, not benchmarks.

Est. speed, Qwen3 8B (Q4_K_M)

RTX 4080 SUPER~106 tok/s · 16 GBRTX 5080~139 tok/s · 16 GBRX 7900 XTX~139 tok/s · 24 GBRTX A4000~65 tok/s · 16 GBRX 6950 XT~83 tok/s · 16 GB

Models at 10+ tok/s (est.)

RTX 4080 SUPER~16 models · $999RTX 5080~16 models · $999RX 7900 XTX~24 models · $999RTX A4000~16 models · $1000RX 6950 XT~16 models · $1099

Top Compatible Models

Top 10 models ranked by performance. Click any model to expand details or view full compatibility.

Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:32b
View full compatibility
Memory Usage23.0 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:27b
View full compatibility
Memory Usage17.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run mistral-small:24b
View full compatibility
Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:32b
View full compatibility
Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5-coder:32b
View full compatibility
Memory Usage21.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:30b-a3b
View full compatibility
Memory Usage15.3 GB
Weights
KV Cache
Overhead
Context Length32,768 tokens
Install with Ollama:
ollama run codestral
View full compatibility
Memory Usage11.8 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:14b-q5_k_m
View full compatibility
Memory Usage12.0 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:14b-q5_k_m
View full compatibility
Memory Usage11.8 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run phi4-q5_k_m
View full compatibility