Boards / Jetson Orin Nano Super
Jetson Orin Nano Super: LLM benchmarks
NVIDIA's small CUDA board in its JetPack 6.2 "Super" (25W / MAXN SUPER) power mode.
At a glance
- Measured runs21
- Models tested12
- Fastest run64.5 tok/s
- SmolLM2 1.7B, INT4, MLC · source ↗
- Sources2
Where to buy
- Jetson Orin Nano Super Developer Kit: $399 raised from $249 (July 2026 report), source ↗ (2026-07-21) Check price on AmazonBuy at Seeed Studio
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| SmolLM2 1.7B | INT4 | MLC | 64.5 | – | – | source ↗ 2025-01-16 |
| Llama 3.2 3B | INT4 | MLC | 43.1 | – | – | source ↗ 2025-01-16 |
| Phi-3.5 3.8B | INT4 | MLC | 38.1 | – | – | source ↗ 2025-01-16 |
| Gemma 2 2B | INT4 | MLC | 35 | – | – | source ↗ 2025-01-16 |
| Qwen2.5 7B | INT4 | MLC | 21.8 | – | – | source ↗ 2025-01-16 |
| Llama 3.1 8B | INT4 | MLC | 19.1 | – | – | source ↗ 2025-01-16 |
| Qwen2.5 0.5B | not reported | Ollama | 13.31 | – | – | source ↗ 2026-04-24 |
| Qwen2.5 0.5B | not reported | Ollama | 13.04 | – | – | source ↗ 2026-04-24 |
| Llama 3.2 1B | not reported | Ollama | 10.96 | – | – | source ↗ 2026-04-24 |
| DeepSeek-R1-Distill-Qwen 1.5B | not reported | Ollama | 9.59 | – | – | source ↗ 2026-04-24 |
| Llama 3.2 1B | not reported | Ollama | 9.51 | – | – | source ↗ 2026-04-24 |
| Qwen2.5 1.5B | not reported | Ollama | 9.37 | – | – | source ↗ 2026-04-24 |
| Gemma 2 9B | INT4 | MLC | 9.2 | – | – | source ↗ 2025-01-16 |
| Qwen2.5 1.5B Instruct | not reported | Ollama | 9.09 | – | – | source ↗ 2026-04-24 |
| Qwen2.5-Coder 1.5B | not reported | Ollama | 8.66 | – | – | source ↗ 2026-04-24 |
| Qwen2.5 1.5B Instruct | not reported | Ollama | 6.9 | – | – | source ↗ 2026-04-24 |
| Qwen2.5-Coder 1.5B | not reported | Ollama | 6.76 | – | – | source ↗ 2026-04-24 |
| Llama 3.2 3B | not reported | Ollama | 6.31 | – | – | source ↗ 2026-04-24 |
| DeepSeek-R1-Distill-Qwen 1.5B | not reported | Ollama | 6.01 | – | – | source ↗ 2026-04-24 |
| Llama 3.2 3B | not reported | Ollama | 4.3 | – | – | source ↗ 2026-04-24 |
| Qwen2.5 1.5B | not reported | Ollama | 4.21 | – | – | source ↗ 2026-04-24 |
Can the Jetson Orin Nano Super run…
Can it run DeepSeek-R1-Distill-Qwen 1.5B?Can it run Gemma 2 2B?Can it run Gemma 2 9B?Can it run Llama 3.1 8B?Can it run Llama 3.2 1B?Can it run Llama 3.2 3B?Can it run Phi-3.5 3.8B?Can it run Qwen2.5 0.5B?Can it run Qwen2.5 1.5B?Can it run Qwen2.5 7B?Can it run Qwen2.5-Coder 1.5B?Can it run SmolLM2 1.7B?
Have this board? Submit your own run →