obs-tgi-metrics-doc · inference-research

Fields

id

sources/obs-tgi-metrics-doc

URL

https://github.com/huggingface/text-generation-inference/blob/main/docs/source/reference/metrics.md

Publisher

huggingface

Kind

repo

Accessed

2026-10-04

notes

The published TGI metric table (21 metrics). It does not include tgi_batch_concat_duration, tgi_batch_inference_failure, tgi_request_failure or tgi_batch_max_total_tokens / tgi_batch_total_tokens, all of which appear in the source - the doc table is behind the code.

Notes

The published TGI metric table (21 metrics). It does not include tgi_batch_concat_duration, tgi_batch_inference_failure, tgi_request_failure or tgi_batch_max_total_tokens / tgi_batch_total_tokens, all of which appear in the source - the doc table is behind the code.

Cross-references

This record references no other records.