inference/research
verifiedhigh · 0.94updated 2026-10-04

vLLM tokens-per-engine-step histogram

vllm · histogram

Fields

id
metric-exposures/w3m-vllm-vllm-iteration-tokens-total
Metric name
vllm:iteration_tokens_total
Metric type
histogram
Unit
tokens
Exposure
prometheus
Endpoint
:8000/metrics
Histogram buckets
18163264128256512102420484096819216384
Labels
model_nameengine
Enabled by default
yes
notes
vLLM main, PrometheusStatLogger in vllm/v1/metrics/loggers.py, read 2026-10-04. On by default (EngineArgs.disable_log_stats defaults False); served at :8000/metrics. Bucket family name in --custom-histogram-buckets: iteration_tokens.

Notes

vLLM main, PrometheusStatLogger in vllm/v1/metrics/loggers.py, read 2026-10-04. On by default (EngineArgs.disable_log_stats defaults False); served at :8000/metrics. Bucket family name in --custom-histogram-buckets: iteration_tokens.

Cross-references

Engine (1)