MiniCPM5 1B (Q4)
Measured across 4 chips under the standard preset.
| Device | Chip | Model | Quant | Runtime | Ctx | TTFT | Decode | Peak RAM | Source |
|---|---|---|---|---|---|---|---|---|---|
| Google Pixel 6 Pro | raven | MiniCPM5 1B (Q4) | Q4_K_M | gguf/cpu | 4096 | 0.70s | 25.4 t/sn=2 | 1.6 GB | community |
| samsung SM-S938B | Snapdragon 8 Elite | MiniCPM5 1B (Q4) | Q4_K_M | gguf/cpu | 4096 | 0.20s | 59.1 t/s | 1.5 GB | community |
| Galaxy S21 Ultrasamsung SM-G998B | exynos2100 | MiniCPM5 1B (Q4) | Q4_K_M | gguf/cpu | 4096 | 1.23s | 17.5 t/s | 1.6 GB | community |
| Galaxy S24 Ultrasamsung SM-S928B | Snapdragon 8 Gen 3 | MiniCPM5 1B (Q4) | Q4_K_M | gguf/cpu | 4096 | 0.32s | 36.9 t/s | 1.4 GB | community |