Boards / Jetson Orin Nano
Jetson Orin Nano (original / mode not stated): LLM benchmarks
Orin Nano results in the original power mode, or where the source did not state the mode.
At a glance
- Measured runs16
- Models tested13
- Fastest run54.8 tok/s
- Llama 3.2 1B, INT4, MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) · source ↗
- Sources4
Where to buy
- Jetson Orin Nano Developer Kit (same hardware, original power mode): $399 same dev kit as Super; Super mode is a JetPack 6.2 flash, source ↗ (2026-07-21) Check price on Amazon
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| Llama 3.2 1B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 54.8 | – | – | source ↗ accessed 2026-10-17 |
| SmolLM2 1.7B | INT4 | MLC | 41 | – | – | source ↗ 2025-01-16 |
| Gemma 4 E2B | not stated | not stated | 34 | – | – | source ↗ 2026-08-25 |
| Llama 3.2 3B | INT4 | MLC | 27.7 | – | – | source ↗ 2025-01-16 |
| Phi-3.5 3.8B | INT4 | MLC | 24.7 | – | – | source ↗ 2025-01-16 |
| Gemma 2 2B | INT4 | MLC | 21.5 | – | – | source ↗ 2025-01-16 |
| Qwen3.5 4B | not stated | not stated | 18 | – | – | source ↗ 2026-08-25 |
| Gemma 4 E4B | not stated | not stated | 17 | – | – | source ↗ 2026-08-25 |
| Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 14.77 | – | – | source ↗ 2026-10-05 |
| Qwen2.5 7B | INT4 | MLC | 14.2 | – | – | source ↗ 2025-01-16 |
| Llama 3.1 8B | INT4 | MLC | 14 | – | – | source ↗ 2025-01-16 |
| Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.98 | – | – | source ↗ 2026-10-05 |
| Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.41 | – | – | source ↗ 2026-10-05 |
| Vinci Piccolo 1.0 (Qwen3.5-4B based) | Q4_K_M | llama.cpp | 13.19 | – | – | source ↗ 2026-10-05 |
| Qwen3.5 9B | not stated | not stated | 12 | – | – | source ↗ 2026-08-25 |
| Gemma 2 9B | INT4 | MLC | 7.2 | – | – | source ↗ 2025-01-16 |
Can the Jetson Orin Nano run…
Can it run Gemma 2 2B?Can it run Gemma 2 9B?Can it run Gemma 4 E2B?Can it run Gemma 4 E4B?Can it run Llama 3.1 8B?Can it run Llama 3.2 1B?Can it run Llama 3.2 3B?Can it run Phi-3.5 3.8B?Can it run Qwen2.5 7B?Can it run Qwen3.5 4B?Can it run Qwen3.5 9B?Can it run SmolLM2 1.7B?Can it run Vinci Piccolo 1.0?
Have this board? Submit your own run →