NVIDIA Jetson page: Thor vLLM DeepSeek-R1 7B, concurrency 1, 41.32 tok/s
41.32 tok/s per request (max concurrency 1)
Fields
id
benchmarks/nv-thor-vllm-deepseek-r1-7b-c1-decodeMetric
decode_tok_s
Value
41.32
Unit
tok/s per request (max concurrency 1)
Model
DeepSeek-R1 7B
Methodology
NVIDIA Developer 'Jetson Benchmarks' page, Jetson AGX Thor Benchmarking Results table, read 2026-10-17. Jetson AGX Thor Developer Kit, JetPack 7.0, CUDA 13.0, TensorRT 10.13, vLLM (version not stated), input sequence length 2048, output sequence length 128. Weight dtype is not stated. The page gives no run count, no variance and no benchmark command, so confidence is below the MLPerf logs. Max concurrency 1 column, per-request rate. The page names the model 'Deepseek R1 7B' and does not give a checkpoint id.
Measured by
vendor
Reproducible
yes
notes
Vendor-measured. Weight quantization is not disclosed on the page, so format_id is left null rather than guessed. VLM rows from the same table were not filed.
Notes
Vendor-measured. Weight quantization is not disclosed on the page, so format_id is left null rather than guessed. VLM rows from the same table were not filed.