vLLM vllm/compilation/backends.py - where the torch.compile cache directory is resolved
repo
Fields
id
sources/w5e-vllm-compilation-backends-cache-dirPublisher
vllm-project
Kind
repo
Accessed
2026-10-05
notes
Read at v0.30.0. Lines ~1062-1086: when compilation_config.cache_dir is empty, vLLM hashes [env_hash, config_hash, code_hash, compiler_hash] with SHA-256, truncates to 10 hex chars, and joins it onto envs.VLLM_CACHE_ROOT/torch_compile_cache. vllm/envs.py line 34 sets VLLM_CACHE_ROOT = os.path.expanduser('~/.cache/vllm'), so with no override the cache root is the invoking user's home directory - inside the container filesystem for a containerised deployment.
Notes
Read at v0.30.0. Lines ~1062-1086: when compilation_config.cache_dir is empty, vLLM hashes [env_hash, config_hash, code_hash, compiler_hash] with SHA-256, truncates to 10 hex chars, and joins it onto envs.VLLM_CACHE_ROOT/torch_compile_cache. vllm/envs.py line 34 sets VLLM_CACHE_ROOT = os.path.expanduser('~/.cache/vllm'), so with no override the cache root is the invoking user's home directory - inside the container filesystem for a containerised deployment.
Cross-references
This record references no other records.