kanshan/nccl-tests
1
0
Fork 0
mirror of https://github.com/NVIDIA/nccl-tests.git synced 2026-01-14 02:47:21 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

doc: add all2all factor

Browse Source
This commit is contained in:
Oren 2024-07-24 22:55:00 -04:00 committed by GitHub
parent d028efcf35
commit c6eb15875f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
doc/PERFORMANCE.md
View File

@ -140,5 +140,6 @@ To obtain a bus bandwidth which should be independent of the number of ranks _n_
* AllGather : (_n_-1)/_n_ * AllGather : (_n_-1)/_n_
* Broadcast : 1 * Broadcast : 1
* Reduce : 1 * Reduce : 1
* AlltoAll: (_n_-1)/_n_
The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network. The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network.