About the model
DeepSeek Coder V2 16B — Mixture-of-Experts code model from DeepSeek, fast on consumer hardware.
Capabilities
✅ Text 💻 Code
Technical specifications
| Type | ollama |
|---|---|
| Parameters | 16B (MoE) |
| Quantization | Q4_K_M |
| Context window | 16384 |
Test hardware
| CPU | AMD Ryzen |
|---|---|
| GPU | NVIDIA RTX 5060 Ti 16GB |
| RAM | 32 GB DDR5 |
| OS | Ubuntu 24.04 LTS |
Test results
| Test | Run | Tokens/s | TTFT (ms) | Duration (s) | Tokens | GPU VRAM | Temp | Quality | Date |
|---|---|---|---|---|---|---|---|---|---|
| ? | #1 | 13.77 | 970 | 122.1 | 1012 | - | - | - | 25.07.2026 |
| ? | #1 | 14.40 | 992 | 184.4 | 1212 | - | - | - | 25.07.2026 |
| ? | #1 | 15.92 | 821 | 116.8 | 1061 | - | - | - | 25.07.2026 |
| ? | #1 | 17.61 | 976 | 104.9 | 890 | - | - | - | 25.07.2026 |