O modelu
The 12B Gemma 4 variant — smaller and faster, a good baseline for comparing how much the larger e4b gains from extra parameters.
Schopnosti
✅ Text 💻 Kód
Technické specifikace
| Type | ollama |
|---|---|
| Parameters | 12B |
| Quantization | Q4_K_M |
| Context window | 32768 |
Hardware pro testy
| CPU | AMD Ryzen |
|---|---|
| GPU | NVIDIA RTX 5060 Ti 16GB |
| RAM | 32 GB DDR5 |
| OS | Ubuntu 24.04 LTS |
Výsledky testů
| Test | Run | Tokens/s | TTFT (ms) | Délka (s) | Tokeny | GPU VRAM | Teplota | Kvalita | Datum |
|---|---|---|---|---|---|---|---|---|---|
| ? | #1 | 42.51 | 137 | 89.3 | 3567 | 7642 MB | 77 °C | - | 23.07.2026 |