Boards Jetson Orin NX 8GB
Jetson Orin NX 8GB (original mode)
Orin NX 8GB module in its original power mode.
- Fastest run
- 51.5 tok/s
- Measured runs
- 7
- Models tested
- 7
- Sources
- 1
Fastest: SmolLM2 1.7B, INT4, MLC · source ↗
Where to buy
- Jetson Orin NX 8GB moduleprice not verified yetBuy at Seeed StudioCheck price on Amazon
Every run on this board
| Model | Size | Runtime | Gen tok/s | Source |
|---|---|---|---|---|
| SmolLM2 1.7B | 1.7B | MLC | 51.5 | source ↗ 2025-01-16 |
| Llama 3.2 3B | 3B | MLC | 34.5 | source ↗ 2025-01-16 |
| Phi-3.5 3.8B | 3.8B | MLC | 30.8 | source ↗ 2025-01-16 |
| Gemma 2 2B | 2B | MLC | 26.6 | source ↗ 2025-01-16 |
| Qwen2.5 7B | 7B | MLC | 17.1 | source ↗ 2025-01-16 |
| Llama 3.1 8B | 8B | MLC | 15.9 | source ↗ 2025-01-16 |
| Gemma 2 9B | 9B | MLC | 8.8 | source ↗ 2025-01-16 |
Can the Jetson Orin NX 8GB run…
Have this board? Submit your own run →