GeForce RTX 3060 8GB
Best local AI models for this GPU
VRAM
8 GB
Bandwidth
240 GB/s
Vendor
NVIDIA
Compatible Models
10
Where to Buy
Top Compatible Models
Top 10 models ranked by performance. Click any model to expand details or view full compatibility.
Memory Usage6.7 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:8b
Memory Usage6.7 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run deepseek-r1:8b
Memory Usage6.6 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.1:8b
Memory Usage6.5 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5:7b
Memory Usage6.5 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen2.5-coder:7b
Memory Usage4.5 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run qwen3:4b
Memory Usage4.5 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:4b
Memory Usage3.9 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.2:3b-q5_k_m
Memory Usage1.7 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:1b-q6_k
Memory Usage1.9 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.2:1b-q6_k