Boards / Rockchip RK3588
RK3588 boards (NPU): LLM benchmarks
The 6-TOPS NPU in Orange Pi 5, Radxa ROCK 5, Indiedroid Nova, ODROID-M2 and friends, driven by RKLLM.
At a glance
- Measured runs25
- Models tested24
- Fastest run62.16 tok/s
- LFM2.5-VL 450M, w8a8, RKLLM v1.3.1 · source ↗
- Sources3
Where to buy
- Radxa ROCK 5B 8GB: $160 listed price, source ↗ (2026-10-17) Check price (affiliate slot)
- Radxa ROCK 5B+ 16GB: $135 listed price, source ↗ (2026-10-17) Check price (affiliate slot)
- Indiedroid Nova + heatsink, fan, eMMC: $199.95 sale price, source ↗ (2026-10-17) Check price (affiliate slot)
- ODROID-M2 w/ case, 64GB eMMC: $299.95 "from" price, source ↗ (2026-10-17) Check price (affiliate slot)
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| LFM2.5-VL 450M | w8a8 | RKLLM v1.3.1 | 62.16 | – | 102.74 | source ↗ commit 2026-09-29 |
| MiniCPM4 0.5B | w8a8 | RKLLM v1.3.1 | 45.34 | – | 135.29 | source ↗ commit 2026-09-29 |
| Qwen2 0.5B | w8a8 | RKLLM v1.3.1 | 41.58 | – | 145.9 | source ↗ commit 2026-09-29 |
| Qwen3 0.6B | w8a8 | RKLLM v1.3.1 | 32.91 | – | 199.09 | source ↗ commit 2026-09-29 |
| DeepSeek-OCR 3B(A570M) | w8a8 | RKLLM v1.3.1 | 31.6 | – | 701.21 | source ↗ commit 2026-09-29 |
| Qwen3.5 0.8B | w8a8 | RKLLM v1.3.1 | 27.05 | – | 587.74 | source ↗ commit 2026-09-29 |
| TinyLlama 1.1B | w8a8 | RKLLM v1.3.1 | 24.43 | – | 243.93 | source ↗ commit 2026-09-29 |
| Qwen2.5 1.5B | w8a8 | RKLLM v1.3.1 | 16.69 | – | 378.31 | source ↗ commit 2026-09-29 |
| Spark-X2.5 1.7B | w8a8 | RKLLM v1.3.1 | 15.61 | – | 386.23 | source ↗ commit 2026-09-29 |
| InternLM2 1.8B | w8a8 | RKLLM v1.3.1 | 15.45 | – | 380.14 | source ↗ commit 2026-09-29 |
| Qwen3-VL 2B | w8a8 | RKLLM v1.3.1 | 14.98 | – | 383.62 | source ↗ commit 2026-09-29 |
| RWKV7 1.5B | w8a8 | RKLLM v1.3.1 | 13.82 | – | 634.34 | source ↗ commit 2026-09-29 |
| Qwen3.5 2B | w8a8 | RKLLM v1.3.1 | 13.59 | – | 776.95 | source ↗ commit 2026-09-29 |
| DeepSeek-R1-Distill-Qwen 1.5B | RKLLM conversion | RKLLM runtime 1.2.1 | 11.5 | – | – | source ↗ repo 2026-01-12 |
| Gemma 4 E2B | w8a8 | RKLLM v1.3.1 | 11.12 | – | 599.06 | source ↗ commit 2026-09-29 |
| Gemma 2 2B | w8a8 | RKLLM v1.3.1 | 10.37 | – | 598.41 | source ↗ commit 2026-09-29 |
| TeleChat2 3B | w8a8 | RKLLM v1.3.1 | 10.18 | – | 618.48 | source ↗ commit 2026-09-29 |
| Gemma 3n 2B | w8a8 | RKLLM v1.3.1 | 9.91 | – | 1124.51 | source ↗ commit 2026-09-29 |
| Qwen2.5 3B Instruct | RKLLM conversion | RKLLM | 8.45 | – | – | source ↗ 2026-01-21 |
| Phi-3 3.8B | w8a8 | RKLLM v1.3.1 | 7.45 | – | 1017.28 | source ↗ commit 2026-09-29 |
| Qwen2.5 3B Instruct | RKLLM conversion | RKLLM runtime 1.2.1 | 7 | – | – | source ↗ repo 2026-01-12 |
| Qwen3.5 4B | w8a8 | RKLLM v1.3.1 | 6.22 | – | 2068.88 | source ↗ commit 2026-09-29 |
| MiniCPM3 4B | w8a8 | RKLLM v1.3.1 | 5.94 | – | 1408.49 | source ↗ commit 2026-09-29 |
| ChatGLM3 6B | w8a8 | RKLLM v1.3.1 | 4.98 | – | 1352.94 | source ↗ commit 2026-09-29 |
| Llama 3.1 8B Instruct | w8a8 (RKLLM conversion) | RKLLM runtime 1.2.1 | 3.72 | – | – | source ↗ repo 2026-01-12 |
Can the Rockchip RK3588 run…
Can it run ChatGLM3 6B?Can it run DeepSeek-OCR 3B?Can it run DeepSeek-R1-Distill-Qwen 1.5B?Can it run Gemma 2 2B?Can it run Gemma 3n 2B?Can it run Gemma 4 E2B?Can it run InternLM2 1.8B?Can it run LFM2.5-VL 450M?Can it run Llama 3.1 8B?Can it run MiniCPM3 4B?Can it run MiniCPM4 0.5B?Can it run Phi-3 3.8B?Can it run Qwen2 0.5B?Can it run Qwen2.5 1.5B?Can it run Qwen2.5 3B?Can it run Qwen3 0.6B?Can it run Qwen3-VL 2B?Can it run Qwen3.5 0.8B?Can it run Qwen3.5 2B?Can it run Qwen3.5 4B?Can it run RWKV7 1.5B?Can it run Spark-X2.5 1.7B?Can it run TeleChat2 3B?Can it run TinyLlama 1.1B?
Have this board? Submit your own run →