obs-trtllm-metrics-collector
repo
Fields
id
sources/obs-trtllm-metrics-collectorPublisher
NVIDIA
Kind
repo
Accessed
2026-10-04
notes
MetricsCollector class. Its docstring enumerates every metric it creates, prefixed trtllm_, and says in the header comment 'Adapted from https://github.com/vllm-project/vllm/blob/v0.10.0rc1/vllm/engine/metrics.py#L30' - i.e. the metric set is an admitted fork of vLLM's. Bucket boundaries for all seven latency histograms are constructor arguments, so they are set by the caller (trtllm-serve), not the library.
Notes
MetricsCollector class. Its docstring enumerates every metric it creates, prefixed trtllm_, and says in the header comment 'Adapted from https://github.com/vllm-project/vllm/blob/v0.10.0rc1/vllm/engine/metrics.py#L30' - i.e. the metric set is an admitted fork of vLLM's. Bucket boundaries for all seven latency histograms are constructor arguments, so they are set by the caller (trtllm-serve), not the library.
Cross-references
This record references no other records.