obs-vllm-production-metrics-doc · inference-research

Fields

id

sources/obs-vllm-production-metrics-doc

URL

https://github.com/vllm-project/vllm/blob/main/docs/usage/metrics.md

Publisher

vllm-project/vllm

Kind

repo

Accessed

2026-10-04

notes

User-facing production metrics page. The metric tables themselves are generated from source by docs/mkdocs/gen_files/generate_metrics.py, which parses loggers.py with ast - so the docs cannot drift from the code. Also documents the --custom-histogram-buckets families and the cardinality warning.

Notes

User-facing production metrics page. The metric tables themselves are generated from source by docs/mkdocs/gen_files/generate_metrics.py, which parses loggers.py with ast - so the docs cannot drift from the code. Also documents the --custom-histogram-buckets families and the cardinality warning.

Cross-references

This record references no other records.