inference/research
verifiedhigh · 0.85updated 2026-10-03

NCCL issue 231: Fail or report when using the same device multiple times in a communicator

repo

Fields

id
sources/mgpu-nccl-231-duplicate-device
Publisher
NVIDIA/nccl
Kind
repo
Published
2019-06-05
Accessed
2026-10-03
notes
Documents that using a CUDA device multiple times as different ranks of one communicator is unsupported per the NCCL developer guide and should ideally return ncclInvalidUsage.

Notes

Documents that using a CUDA device multiple times as different ranks of one communicator is unsupported per the NCCL developer guide and should ideally return ncclInvalidUsage.

Cross-references

This record references no other records.