obs-lmdeploy-metrics-loggers · inference-research

Fields

id

sources/obs-lmdeploy-metrics-loggers

URL

https://github.com/InternLM/lmdeploy/blob/main/lmdeploy/metrics/loggers.py

Publisher

InternLM

Kind

repo

Accessed

2026-10-04

notes

The LMDeploy MetricsLogger. Same metric names and same vLLM bucket-building idiom (build_buckets / build_1_2_5_buckets) but two divergences worth knowing: lmdeploy:iter_token_latency has no _seconds suffix, and there is no preemption metric at all - grep for 'preempt' in this file returns nothing.

Notes

The LMDeploy MetricsLogger. Same metric names and same vLLM bucket-building idiom (build_buckets / build_1_2_5_buckets) but two divergences worth knowing: lmdeploy:iter_token_latency has no _seconds suffix, and there is no preemption metric at all - grep for 'preempt' in this file returns nothing.

Cross-references

This record references no other records.