vLLM queue-time histogram (time in WAITING phase)
vllm · histogram
Fields
id
metric-exposures/w3m-vllm-vllm-request-queue-time-secondsMetric name
vllm:request_queue_time_seconds
Metric type
histogram
Unit
seconds
Exposure
prometheus
Endpoint
:8000/metrics
Histogram buckets
0.30.50.811.522.551015203040506012024048096019207680
Labels
model_nameengine
Enabled by default
yes
Phase scoped
yes
notes
vLLM main, PrometheusStatLogger in vllm/v1/metrics/loggers.py, read 2026-10-04. On by default (EngineArgs.disable_log_stats defaults False); served at :8000/metrics. Bucket family name in --custom-histogram-buckets: request_latency. Because the family's first bound is 0.3 s, this histogram cannot resolve a sub-300ms queueing SLO without --custom-histogram-buckets. vllm:time_in_queue_requests was a duplicate of this metric and is gone.
Notes
vLLM main, PrometheusStatLogger in vllm/v1/metrics/loggers.py, read 2026-10-04. On by default (EngineArgs.disable_log_stats defaults False); served at :8000/metrics. Bucket family name in --custom-histogram-buckets: request_latency. Because the family's first bound is 0.3 s, this histogram cannot resolve a sub-300ms queueing SLO without --custom-histogram-buckets. vllm:time_in_queue_requests was a duplicate of this metric and is gone.