obs-tgi-tracing-py · inference-research

Fields

id

sources/obs-tgi-tracing-py

URL

https://github.com/huggingface/text-generation-inference/blob/main/server/text_generation_server/tracing.py

Publisher

huggingface

Kind

repo

Accessed

2026-10-04

notes

63 lines total. setup_tracing(otlp_service_name, otlp_endpoint) installs a BatchSpanProcessor with an OTLP gRPC exporter, and a custom UDSOpenTelemetryAioServerInterceptor overrides _start_span to handle gRPC-over-Unix-socket calls. Span names are the raw gRPC method names with rpc.* attributes - generic RPC spans, not gen_ai spans.

Notes

63 lines total. setup_tracing(otlp_service_name, otlp_endpoint) installs a BatchSpanProcessor with an OTLP gRPC exporter, and a custom UDSOpenTelemetryAioServerInterceptor overrides _start_span to handle gRPC-over-Unix-socket calls. Span names are the raw gRPC method names with rpc.* attributes - generic RPC spans, not gen_ai spans.

Cross-references

This record references no other records.