inference/research
verifiedhigh · 0.93updated 2026-10-05

Dynamo components/src/dynamo/common/backend/metrics.py - bridging vendor engine registries into one /metrics

repo

Fields

id
sources/w5e-dynamo-vendor-registry-bridge
Publisher
NVIDIA
Kind
repo
Accessed
2026-10-05
notes
Read at main 2026-10-05. This is the mechanism a reader needs before trusting any /metrics on a Dynamo deployment: engines call register_global_registry (default prometheus_client.REGISTRY) or register_engine_registry (a custom CollectorRegistry they own, e.g. SGLang's multiprocess registry) and their VENDOR-PREFIXED series (vllm:, sglang:, trtllm_, lmcache:) are bridged into the runtime's combined output with auto-labels injected at scrape time. ensure_prometheus_multiproc_dir() sets PROMETHEUS_MULTIPROC_DIR for the engine's lifetime and the docstring notes vLLM reads it on every registry touch, so it must persist past start(). Both a prometheus expfmt callback and a typed callback are registered, so the /metrics text and the OTLP export carry the same series. Consequence for this corpus: a Dynamo /metrics endpoint shows ENGINE metrics whose names are recorded against those engines, not against Dynamo.

Notes

Read at main 2026-10-05. This is the mechanism a reader needs before trusting any /metrics on a Dynamo deployment: engines call register_global_registry (default prometheus_client.REGISTRY) or register_engine_registry (a custom CollectorRegistry they own, e.g. SGLang's multiprocess registry) and their VENDOR-PREFIXED series (vllm:, sglang:, trtllm_, lmcache:) are bridged into the runtime's combined output with auto-labels injected at scrape time. ensure_prometheus_multiproc_dir() sets PROMETHEUS_MULTIPROC_DIR for the engine's lifetime and the docstring notes vLLM reads it on every registry touch, so it must persist past start(). Both a prometheus expfmt callback and a typed callback are registered, so the /metrics text and the OTLP export carry the same series. Consequence for this corpus: a Dynamo /metrics endpoint shows ENGINE metrics whose names are recorded against those engines, not against Dynamo.

Cross-references

This record references no other records.