obs-sglang-metrics-collector · inference-research

Fields

id

sources/obs-sglang-metrics-collector

URL

https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/observability/metrics_collector.py

Publisher

sgl-project/sglang

Kind

repo

Accessed

2026-10-04

notes

The SGLangMetricsCollector class. Grepping name="sglang: yields ~180 metric names, most behind feature flags. The core latency histograms are defined near line 1783 and the scheduler-state gauges near line 284. Also contains the comment 'FIXME: misleadingly named token_usage; rename requires API deprecation' on sglang:token_usage.

Notes

The SGLangMetricsCollector class. Grepping name="sglang: yields ~180 metric names, most behind feature flags. The core latency histograms are defined near line 1783 and the scheduler-state gauges near line 284. Also contains the comment 'FIXME: misleadingly named token_usage; rename requires API deprecation' on sglang:token_usage.

Cross-references

This record references no other records.