GeForce GTX 960 4GB

Best local AI models for this GPU

VRAM
4 GB
Bandwidth
112 GB/s
Vendor
NVIDIA
Compatible Models
2

How it compares

GeForce GTX 960 4GB vs GPUs at nearby launch prices. Estimates from memory bandwidth, not benchmarks.

Est. speed, Qwen3 8B (Q4_K_M)

GTX 1660~28 tok/s · 6 GBArc B570~55 tok/s · 10 GBGTX 960 4GB~16 tok/s · 4 GBRX 580~37 tok/s · 8 GBGTX 1660 SUPER~48 tok/s · 6 GB

Models at 10+ tok/s (est.)

GTX 1660~5 models · $219Arc B570~11 models · $219GTX 960 4GB~2 models · $229RX 580~10 models · $229GTX 1660 SUPER~5 models · $229

Top Compatible Models

Top 2 models ranked by performance. Click any model to expand details or view full compatibility.

Memory Usage1.7 GB
Weights
KV Cache
Overhead
Context Length16,384 tokens
Install with Ollama:
ollama run gemma3:1b-q6_k
View full compatibility
Memory Usage1.9 GB
Weights
KV Cache
Overhead
Context Length131,072 tokens
Install with Ollama:
ollama run llama3.2:1b-q6_k
View full compatibility