Instinct MI100
Best local AI models for this GPU
VRAM
32 GB
Bandwidth
1229 GB/s
Vendor
AMD
Compatible Models
24
Where to Buy
Top Compatible Models
Top 10 models ranked by performance. Click any model to expand details or view full compatibility.
Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:32b
Memory Usage23.0 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:27b
Memory Usage17.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run mistral-small:24b
Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:32b
Memory Usage21.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5-coder:32b
Memory Usage24.9 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:30b-a3b-q5_k_m
Memory Usage15.3 GB
Weights
KV Cache
Overhead
Context Length32,768 tokens
Install with Ollama:
ollama run codestral
Memory Usage13.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:14b-q6_k
Memory Usage14.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:14b-q6_k
Memory Usage13.5 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run phi4-q6_k