TEI next-batch-token histogram
niche-text-embeddings-inference · histogram
Fields
id
metric-exposures/w5e-tei-te-batch-next-tokensMetric name
te_batch_next_tokens
Metric type
histogram
Unit
tokens
Exposure
prometheus
Endpoint
:9000/metrics (--prometheus-port, default 9000)
Histogram buckets
124816326412825651210242048409681921638432768655361310722621445242881048576
Enabled by default
yes
notes
Matcher::Full("te_batch_next_tokens"), 21 bounds 2^0..2^20 (1 to 1048576). The token-denominated companion to te_batch_next_size; where size says how many sequences, this says how much work.
Notes
Matcher::Full("te_batch_next_tokens"), 21 bounds 2^0..2^20 (1 to 1048576). The token-denominated companion to te_batch_next_size; where size says how many sequences, this says how much work.