inference/research
verifiedhigh · 0.95updated 2026-10-04

obs-llamacpp-server-readme-metrics

repo

Fields

id
sources/obs-llamacpp-server-readme-metrics
Publisher
ggml-org
Kind
repo
Accessed
2026-10-04
notes
The /metrics and /slots documentation. --metrics enable prometheus compatible metrics endpoint (default: disabled); --slots expose slots monitoring endpoint (default: enabled). The /slots JSON per-slot timings object is the only place per-request decode timing exists. Confirms there is no OTel: an in-repo search for 'opentelemetry' in ggml-org/llama.cpp returns 0 code hits.

Notes

The /metrics and /slots documentation. --metrics enable prometheus compatible metrics endpoint (default: disabled); --slots expose slots monitoring endpoint (default: enabled). The /slots JSON per-slot timings object is the only place per-request decode timing exists. Confirms there is no OTel: an in-repo search for 'opentelemetry' in ggml-org/llama.cpp returns 0 code hits.

Cross-references

This record references no other records.