obs-sglang-production-metrics-doc
repo
Fields
id
sources/obs-sglang-production-metrics-docPublisher
sgl-project/sglang
Kind
repo
Accessed
2026-10-04
notes
Documents that metrics require --enable-metrics, links the shipped Grafana dashboard, and states the TTFT definition precisely: 'time from request creation in the API server to the first token. For streaming requests it ends when the first output arrives after detokenization, which may contain no printable text.'
Notes
Documents that metrics require --enable-metrics, links the shipped Grafana dashboard, and states the TTFT definition precisely: 'time from request creation in the API server to the first token. For streaming requests it ends when the first output arrives after detokenization, which may contain no printable text.'
Cross-references
This record references no other records.