RTX 2000 Ada

Best local AI models for this GPU

VRAM
16 GB
Bandwidth
224 GB/s
Vendor
NVIDIA
Compatible Models
16

Top Compatible Models

Top 10 models ranked by performance. Click any model to expand details or view full compatibility.

Memory Usage11.8 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:14b-q5_k_m
View full compatibility
Memory Usage12.0 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:14b-q5_k_m
View full compatibility
Memory Usage11.8 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run phi4-q5_k_m
View full compatibility
Memory Usage13.2 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:12b
View full compatibility
Memory Usage12.0 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:14b-q5_k_m
View full compatibility
Memory Usage11.9 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run mistral-nemo-q6_k
View full compatibility
Memory Usage7.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:8b-q5_k_m
View full compatibility
Memory Usage7.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:8b-q5_k_m
View full compatibility
Memory Usage7.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.1:8b-q5_k_m
View full compatibility
Memory Usage7.2 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:7b-q5_k_m
View full compatibility