From c6eb15875f508076f3f26de4f7da3899701bc4db Mon Sep 17 00:00:00 2001 From: Oren <47992694+OrenLeung@users.noreply.github.com> Date: Wed, 24 Jul 2024 22:55:00 -0400 Subject: [PATCH] doc: add all2all factor --- doc/PERFORMANCE.md | 1 + 1 file changed, 1 insertion(+) diff --git a/doc/PERFORMANCE.md b/doc/PERFORMANCE.md index 21fef60..942f054 100644 --- a/doc/PERFORMANCE.md +++ b/doc/PERFORMANCE.md @@ -140,5 +140,6 @@ To obtain a bus bandwidth which should be independent of the number of ranks _n_ * AllGather : (_n_-1)/_n_ * Broadcast : 1 * Reduce : 1 +* AlltoAll: (_n_-1)/_n_ The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network.