inference/research
verifiedhigh · 0.90updated 2026-10-04

vLLM AsyncEngineArgs defaults for the ops-relevant engine and scheduler knobs

repo

Fields

id
sources/ops-vllm-engine-arg-defaults
Publisher
vLLM project
Kind
repo
Published
main branch as of 2026-10-04
Accessed
2026-10-04
notes
Defaults transcribed from the dataclass fields: shutdown_timeout: int = 0; max_num_queued_reqs: int | None = None; max_num_queued_tokens: int | None = None; max_num_seqs: int | None = None; max_num_batched_tokens: int | None = None; max_num_scheduled_tokens: int | None = None; max_num_active_seqs inherited from SchedulerConfig; long_prefill_token_threshold and long_prefill_token_threshold_adaptive inherited from SchedulerConfig; gpu_memory_utilization and kv_cache_memory_bytes inherited from CacheConfig. The load-bearing fact for an ops record is that shutdown_timeout, max_num_queued_reqs and max_num_queued_tokens all default to off (0 or None), so a stock deployment has no in-flight drain window and no queue admission bound.

Notes

Defaults transcribed from the dataclass fields: shutdown_timeout: int = 0; max_num_queued_reqs: int | None = None; max_num_queued_tokens: int | None = None; max_num_seqs: int | None = None; max_num_batched_tokens: int | None = None; max_num_scheduled_tokens: int | None = None; max_num_active_seqs inherited from SchedulerConfig; long_prefill_token_threshold and long_prefill_token_threshold_adaptive inherited from SchedulerConfig; gpu_memory_utilization and kv_cache_memory_bytes inherited from CacheConfig. The load-bearing fact for an ops record is that shutdown_timeout, max_num_queued_reqs and max_num_queued_tokens all default to off (0 or None), so a stock deployment has no in-flight drain window and no queue admission bound.

Cross-references

This record references no other records.