inference/research
verifiedlow · 0.60updated 2026-10-11

smcleod.net: patching the NVIDIA open GPU kernel modules to force BAR1 P2P on consumer cards, and retuning vLLM's fused MoE for RTX 3090

blog

Fields

id
sources/comm-blog-smcleod-p2p-patched-driver
Publisher
smcleod.net (individual practitioner blog)
Kind
blog
Accessed
2026-10-11
notes
Single practitioner, self-hosted. Names the community fork it builds on: aikitoria/open-gpu-kernel-modules. Patches the open kernel driver to force BAR1 P2P; requires IOMMU in passthrough mode (amd_iommu=on iommu=pt), which the author flags as weakening isolation. Driver version stated as 590.48.01 at time of writing. The results table reports vLLM and llama.cpp VERSION FIELDS AS EMPTY, so engine versions for the throughput figures are unknown - a reproducibility gap this record preserves rather than fills. Author's own engine opinion: llama.cpp is the daily server, vLLM wins on heavy/performance-sensitive and MoE-tensor-parallel workloads but is harder to set up, needs per-model config, and has sub-optimal topology handling for uneven GPU counts. 2026-10-11: Re-read blog post. Confirms author patched open GPU kernel modules (590.48.01) with IOMMU passthrough to enable BAR1 P2P on dual RTX 3090s. Retained at confidence 0.6 due to missing engine version numbers.

Notes

Single practitioner, self-hosted. Names the community fork it builds on: aikitoria/open-gpu-kernel-modules. Patches the open kernel driver to force BAR1 P2P; requires IOMMU in passthrough mode (amd_iommu=on iommu=pt), which the author flags as weakening isolation. Driver version stated as 590.48.01 at time of writing. The results table reports vLLM and llama.cpp VERSION FIELDS AS EMPTY, so engine versions for the throughput figures are unknown - a reproducibility gap this record preserves rather than fills. Author's own engine opinion: llama.cpp is the daily server, vLLM wins on heavy/performance-sensitive and MoE-tensor-parallel workloads but is harder to set up, needs per-model config, and has sub-optimal topology handling for uneven GPU counts.

2026-10-11: Re-read blog post. Confirms author patched open GPU kernel modules (590.48.01) with IOMMU passthrough to enable BAR1 P2P on dual RTX 3090s. Retained at confidence 0.6 due to missing engine version numbers.

Cross-references

This record references no other records.