Boards / M5Stack LLM8850
M5Stack LLM8850 M.2 (AX8850): LLM benchmarks
An AX8850 accelerator on an M.2 card, for adding an NPU to another host.
At a glance
- Measured runs7
- Models tested7
- Fastest run27.05 tok/s
- Qwen2.5 0.5B Instruct, W4A16, StackFlow · source ↗
- Sources1
Where to buy
- M5Stack LLM8850 M.2 card (AX8850): price not verified yet Check price on Amazon
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| Qwen2.5 0.5B Instruct | W4A16 | StackFlow | 27.05 | – | – | source ↗ accessed 2026-10-17 |
| MiniCPM4 0.5B | W8A16 | StackFlow | 21.05 | – | 212.91 | source ↗ accessed 2026-10-17 |
| Qwen2.5 1.5B Instruct | W4A16 | StackFlow | 15.06 | – | – | source ↗ accessed 2026-10-17 |
| DeepSeek-R1-Distill-Qwen 1.5B | W4A16 | StackFlow | 13.29 | – | – | source ↗ accessed 2026-10-17 |
| Qwen3 0.6B | W8A16 | StackFlow | 12.88 | – | 670.51 | source ↗ accessed 2026-10-17 |
| Qwen3-VL 2B Instruct | W8A16 | StackFlow | 7.8 | – | – | source ↗ accessed 2026-10-17 |
| Qwen3 1.7B | W8A16 | StackFlow | 7.38 | – | 796.38 | source ↗ accessed 2026-10-17 |
Can the M5Stack LLM8850 run…
Can it run DeepSeek-R1-Distill-Qwen 1.5B?Can it run MiniCPM4 0.5B?Can it run Qwen2.5 0.5B?Can it run Qwen2.5 1.5B?Can it run Qwen3 0.6B?Can it run Qwen3 1.7B?Can it run Qwen3-VL 2B?
Have this board? Submit your own run →