obs-trtllm-tracing-py · inference-research

Fields

id

sources/obs-trtllm-tracing-py

URL

https://github.com/NVIDIA/TensorRT-LLM/blob/main/tensorrt_llm/llmapi/tracing.py

Publisher

NVIDIA

Kind

repo

Accessed

2026-10-04

notes

trace_span(name) decorator wrapping async functions with SpanKind.SERVER; is_tracing_enabled() gates it. Functions decorated include insufficient_request_metrics_warning, meaning the tracer is also used to flag requests that arrived without enough metrics to be evaluated - a nice detail for SLO work.

Notes

trace_span(name) decorator wrapping async functions with SpanKind.SERVER; is_tracing_enabled() gates it. Functions decorated include insufficient_request_metrics_warning, meaning the tracer is also used to flag requests that arrived without enough metrics to be evaluated - a nice detail for SLO work.

Cross-references

This record references no other records.