GeForce RTX 2080 Ti

Best local AI models for this GPU

VRAM
11 GB
Bandwidth
616 GB/s
Vendor
NVIDIA
Compatible Models
11

How it compares

GeForce RTX 2080 Ti vs GPUs at nearby launch prices. Estimates from memory bandwidth, not benchmarks.

Est. speed, Qwen3 8B (Q4_K_M)

GTX TITAN X~48 tok/s · 12 GBRX 6900 XT~74 tok/s · 16 GBRTX 2080 Ti~89 tok/s · 11 GBRTX 4080 SUPER~106 tok/s · 16 GBRTX 5080~139 tok/s · 16 GB

Models at 10+ tok/s (est.)

GTX TITAN X~15 models · $999RX 6900 XT~16 models · $999RTX 2080 Ti~11 models · $999RTX 4080 SUPER~16 models · $999RTX 5080~16 models · $999

Top Compatible Models

Top 10 models ranked by performance. Click any model to expand details or view full compatibility.

Memory Usage9.2 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run mistral-nemo
View full compatibility
Memory Usage7.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:8b-q5_k_m
View full compatibility
Memory Usage7.4 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:8b-q5_k_m
View full compatibility
Memory Usage7.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.1:8b-q5_k_m
View full compatibility
Memory Usage7.2 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:7b-q5_k_m
View full compatibility
Memory Usage7.2 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5-coder:7b-q5_k_m
View full compatibility
Memory Usage5.3 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:4b-q6_k
View full compatibility
Memory Usage5.2 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:4b-q6_k
View full compatibility
Memory Usage4.2 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.2:3b-q6_k
View full compatibility
Memory Usage1.7 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:1b-q6_k
View full compatibility