Zongfei Jing dbaddb3a29 Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) ... * Adding two-shot allreduce kernel and mnnvl multicasting buffergit gffe Signed-off-by: Shiyu Li <shili@nvidia.com> Adding comments Signed-off-by: Shiyu Li <shili@nvidia.com> Add unittest of the twoshot kernel. Signed-off-by: Shiyu Li <shili@nvidia.com> Update dispatch logic Signed-off-by: Shiyu Li <shili@nvidia.com> Use cpu barrier instead of GPU at init Signed-off-by: Shiyu Li <shili@nvidia.com> Merge dispatch logic fix Signed-off-by: Shiyu Li <shili@nvidia.com> Update the kernel to use GPU-managed buffer Signed-off-by: Shiyu Li <shili@nvidia.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix issue Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean up Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Simplify AllReduce interface Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix warning Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Tidy code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Skip ut for no_fusion Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Shiyu Li <shili@nvidia.com> Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> Co-authored-by: Shiyu Li <shili@nvidia.com>		2025-05-22 03:42:36 +08:00
..
allReduceFusionKernels.cu	fix potential issues in allreduce fusion kernel and ut (#4226)	2025-05-19 17:38:29 +08:00
allReduceFusionKernels.h	Unify two versions of AllReduce custom op (#3032)	2025-04-22 21:58:42 +08:00
allReduceWorkspace.cu	chore: bump version to 0.19.0 (#3598) (#3841)	2025-04-29 16:57:22 +08:00
allReduceWorkspace.h	feat: fix and improve allreduce and fusion kernels (#3064)	2025-04-08 19:33:52 +08:00
customLowPrecisionAllReduceKernels.cu	feat: Low Precision Allreduce for PCIe based GPU (#4344)	2025-05-20 06:53:46 +08:00
customLowPrecisionAllReduceKernels.h	feat: Low Precision Allreduce for PCIe based GPU (#4344)	2025-05-20 06:53:46 +08:00
mnnvlTwoShotAllreduceKernels.cu	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
mnnvlTwoShotAllreduceKernels.h	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
moeAllReduceFusionKernels.cu	fix potential issues in allreduce fusion kernel and ut (#4226)	2025-05-19 17:38:29 +08:00
moeAllReduceFusionKernels.h	feat: fix and improve allreduce and fusion kernels (#3064)	2025-04-08 19:33:52 +08:00