obs-sglang-utilization-regression

Fields

id

sources/obs-sglang-utilization-regression

URL

https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/managers/scheduler_components/metrics_reporter.py

Publisher

sgl-project/sglang

Kind

repo

Accessed

2026-10-04

notes

Contains the inline comment 'TODO: max_running_requests_under_SLO has no setter - sglang:utilization stuck at 0 (regressed #22713)'. _calculate_utilization falls back to getattr(self.scheduler, 'max_running_requests_under_SLO', None) and the scheduler passes max_running_requests_under_SLO=None with 'TODO: ... dead chain'. So sglang:utilization and sglang:max_running_requests_under_SLO are documented-but-dead on current main.

Notes

Contains the inline comment 'TODO: max_running_requests_under_SLO has no setter - sglang:utilization stuck at 0 (regressed #22713)'. _calculate_utilization falls back to getattr(self.scheduler, 'max_running_requests_under_SLO', None) and the scheduler passes max_running_requests_under_SLO=None with 'TODO: ... dead chain'. So sglang:utilization and sglang:max_running_requests_under_SLO are documented-but-dead on current main.

Cross-references

This record references no other records.