inference/research
verifiedhigh · 0.95updated 2026-10-04

vLLM documentation: Security (docs/usage/security.md)

repo

Fields

id
sources/sec-vllm-security-doc
Publisher
vLLM project
Kind
repo
Published
2026-10-04
Accessed
2026-10-04
notes
Upstream's own statement of its threat model: ALL inter-node communication is insecure by default and must be protected by network isolation - PyTorch Distributed, KV cache transfer, and tensor/pipeline/data parallel communications. PyTorch Distributed has no authorization protocol, sends messages unencrypted, and accepts connections from anywhere. --allowed-media-domains is the documented SSRF control and it applies to the batch runner as well as online serving.

Notes

Upstream's own statement of its threat model: ALL inter-node communication is insecure by default and must be protected by network isolation - PyTorch Distributed, KV cache transfer, and tensor/pipeline/data parallel communications. PyTorch Distributed has no authorization protocol, sends messages unencrypted, and accepts connections from anywhere. --allowed-media-domains is the documented SSRF control and it applies to the batch runner as well as online serving.

Cross-references

This record references no other records.