inference/research
verifiedhigh · 0.95updated 2026-10-04

obs-trtllm-metrics-collector

repo

Fields

id
sources/obs-trtllm-metrics-collector
Publisher
NVIDIA
Kind
repo
Accessed
2026-10-04
notes
MetricsCollector class. Its docstring enumerates every metric it creates, prefixed trtllm_, and says in the header comment 'Adapted from https://github.com/vllm-project/vllm/blob/v0.10.0rc1/vllm/engine/metrics.py#L30' - i.e. the metric set is an admitted fork of vLLM's. Bucket boundaries for all seven latency histograms are constructor arguments, so they are set by the caller (trtllm-serve), not the library.

Notes

MetricsCollector class. Its docstring enumerates every metric it creates, prefixed trtllm_, and says in the header comment 'Adapted from https://github.com/vllm-project/vllm/blob/v0.10.0rc1/vllm/engine/metrics.py#L30' - i.e. the metric set is an admitted fork of vLLM's. Bucket boundaries for all seven latency histograms are constructor arguments, so they are set by the caller (trtllm-serve), not the library.

Cross-references

This record references no other records.