r/LocalLLaMA: vLLM vs SGLang on 2 Nvidia GPUs thread, answer by u/randomfoo2

Fields

id

sources/sent-src-reddit-vllm-vs-sglang-1jjl45h

URL

https://www.reddit.com/r/LocalLLaMA/comments/1jjl45h/compared_performance_of_vllm_vs_sglang_on_2/mjo82c5/

Publisher

Reddit / u/randomfoo2

Kind

forum

Accessed

2026-10-04

notes

Comment displayed at 107 upvotes; parent thread 98 upvotes, 33 comments, shown as '2yr ago' at access 2026-10-04. Practitioner running 70B+ at tp=4..16 on 2xH100 nodes, swapping between both engines for dev/synthetic data. Cites https://shisa.ai/posts/tuning-vllm-mi300x/ and an EAGLE team throughput post. Upvote count is a popularity proxy, not a measurement.

Notes

Comment displayed at 107 upvotes; parent thread 98 upvotes, 33 comments, shown as '2yr ago' at access 2026-10-04. Practitioner running 70B+ at tp=4..16 on 2xH100 nodes, swapping between both engines for dev/synthetic data. Cites https://shisa.ai/posts/tuning-vllm-mi300x/ and an EAGLE team throughput post. Upvote count is a popularity proxy, not a measurement.

Cross-references

This record references no other records.