inference/research
verifiedhigh · 0.95updated 2026-10-03

llama.cpp server documentation

repo

Fields

id
sources/engine-llamacpp-server
Publisher
ggml-org
Kind
repo
Accessed
2026-10-03
notes
llama-server docs. Source for llama.cpp's continuous batching, slot management and KV cache type flags.

Notes

llama-server docs. Source for llama.cpp's continuous batching, slot management and KV cache type flags.

Cross-references

This record references no other records.