obs-vllm-observability-config · inference-research

Fields

id

sources/obs-vllm-observability-config

URL

https://github.com/vllm-project/vllm/blob/main/vllm/config/observability.py

Publisher

vllm-project/vllm

Kind

repo

Accessed

2026-10-04

notes

The ObservabilityConfig model: otlp_traces_endpoint, collect_detailed_traces, per_request_spec_decode_metrics, kv_cache_metrics / kv_cache_metrics_sample, custom_histogram_buckets, show_hidden_metrics_for_version, enable_mfu_metrics, enable_layerwise_nvtx_tracing. Field docstrings are the authoritative statement of which knobs are default-off.

Notes

The ObservabilityConfig model: otlp_traces_endpoint, collect_detailed_traces, per_request_spec_decode_metrics, kv_cache_metrics / kv_cache_metrics_sample, custom_histogram_buckets, show_hidden_metrics_for_version, enable_mfu_metrics, enable_layerwise_nvtx_tracing. Field docstrings are the authoritative statement of which knobs are default-off.

Cross-references

This record references no other records.