Zongfei Jing dbaddb3a29 Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) ... * Adding two-shot allreduce kernel and mnnvl multicasting buffergit gffe Signed-off-by: Shiyu Li <shili@nvidia.com> Adding comments Signed-off-by: Shiyu Li <shili@nvidia.com> Add unittest of the twoshot kernel. Signed-off-by: Shiyu Li <shili@nvidia.com> Update dispatch logic Signed-off-by: Shiyu Li <shili@nvidia.com> Use cpu barrier instead of GPU at init Signed-off-by: Shiyu Li <shili@nvidia.com> Merge dispatch logic fix Signed-off-by: Shiyu Li <shili@nvidia.com> Update the kernel to use GPU-managed buffer Signed-off-by: Shiyu Li <shili@nvidia.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix issue Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean up Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Simplify AllReduce interface Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix warning Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Tidy code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Skip ut for no_fusion Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Shiyu Li <shili@nvidia.com> Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> Co-authored-by: Shiyu Li <shili@nvidia.com>		2025-05-22 03:42:36 +08:00
..
batch_manager	refactor: Unify request order in TRT and PyTorch workflow (#4096)	2025-05-20 18:49:27 +02:00
common	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
cutlass_extensions/include/cutlass_extensions	[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper (#4123)	2025-05-14 15:48:07 +08:00
executor	[TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936)	2025-05-21 10:40:00 +08:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
layers	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
plugins	Fix bias shape in weightOnlyGroupwiseQuantMatmulPlugin for TRT workflow (#4348)	2025-05-16 10:02:30 +08:00
pybind	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
runtime	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
testing	refactor: Move ModelSpec to core library (#3980)	2025-05-04 01:39:09 +08:00
thop	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
CMakeLists.txt	feat: NIXL interface integration (#3934)	2025-05-19 18:18:22 +08:00