TEI failed-request counter
niche-text-embeddings-inference · counter
Fields
id
metric-exposures/w5e-tei-te-request-failureMetric name
te_request_failure
Metric type
counter
Unit
requests
Exposure
prometheus
Endpoint
:9000/metrics (--prometheus-port, default 9000)
Labels
err
Enabled by default
yes
notes
metrics::counter!("te_request_failure", "err" => ...) with err taking values such as "batch_size" and "validation". THE err LABEL IS THE POINT: unlike most engines, TEI separates validation rejections (HTTP 400/413) from server-side failures, so a 4xx storm is distinguishable from a 5xx storm in one series instead of needing the HTTP status metric other engines substitute.
Notes
metrics::counter!("te_request_failure", "err" => ...) with err taking values such as "batch_size" and "validation". THE err LABEL IS THE POINT: unlike most engines, TEI separates validation rejections (HTTP 400/413) from server-side failures, so a 4xx storm is distinguishable from a 5xx storm in one series instead of needing the HTTP status metric other engines substitute.