vLLM PR 51241: Add /dev/shm size calculator for tensor parallel deployment

Fields

id

sources/mgpu-vllm-51241-shm-calculator

URL

https://github.com/vllm-project/vllm/pull/51241

Publisher

vllm-project/vllm

Kind

repo

Published

2026-08-06

Accessed

2026-10-03

notes

Maintains the four IPC components that scale with TP (NCCL ring buffers, PyTorch tensor descriptors, KV block tables, MMAP batch buffers) and states the 64 MiB default container /dev/shm is far too small.

Notes

Maintains the four IPC components that scale with TP (NCCL ring buffers, PyTorch tensor descriptors, KV block tables, MMAP batch buffers) and states the 64 MiB default container /dev/shm is far too small.

Cross-references

This record references no other records.