Rockchip RK3576 / Spark-X2.5 1.7B

Can a Rockchip RK3576 run Spark-X2.5 1.7B?

Yes, at a comfortable chat speed. Measured generation speed: 7.89–13.57 tok/s across 3 public runs.

Rule of thumb: 10+ tok/s feels like a chat; 4–10 is usable for assistants and automations; under 4 is batch-job territory. Speeds depend on quantization, runtime, context length and cooling. Check each source.

BoardQuantRuntimeGen tok/sPrompt tok/sTTFT msSource
Rockchip RK3576
Rockchip RK3576 (vendor reference board)
w4a16RKLLM v1.3.113.57–768.66source ↗
commit 2026-09-29
Rockchip RK3576
Rockchip RK3576 (vendor reference board)
w4a16_g128RKLLM v1.3.112.14–981.5source ↗
commit 2026-09-29
Rockchip RK3576
Rockchip RK3576 (vendor reference board)
w8a8RKLLM v1.3.17.89–803.94source ↗
commit 2026-09-29

Spark-X2.5 1.7B on other boards

Buy a Rockchip RK3576

Ran Spark-X2.5 1.7B on a Rockchip RK3576? Submit your numbers →

Get the monthly board report

New boards, new runtimes, new numbers. One email a month, no hype.