TEI request counter
niche-text-embeddings-inference · counter
Fields
id
metric-exposures/w5e-tei-te-request-countMetric name
te_request_count
Metric type
counter
Unit
requests
Exposure
prometheus
Endpoint
:9000/metrics (--prometheus-port, default 9000)
Labels
method
Enabled by default
yes
notes
router/src/http/server.rs: metrics::counter!("te_request_count", "method" => "single") and "method" => "batch". The method label is the only label on this metric and it takes exactly two values, so cardinality is trivial - this is a safe metric to keep at per-request granularity.
Notes
router/src/http/server.rs: metrics::counter!("te_request_count", "method" => "single") and "method" => "batch". The method label is the only label on this metric and it takes exactly two values, so cardinality is trivial - this is a safe metric to keep at per-request granularity.