Zongfei Jing dbaddb3a29 Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) ... * Adding two-shot allreduce kernel and mnnvl multicasting buffergit gffe Signed-off-by: Shiyu Li <shili@nvidia.com> Adding comments Signed-off-by: Shiyu Li <shili@nvidia.com> Add unittest of the twoshot kernel. Signed-off-by: Shiyu Li <shili@nvidia.com> Update dispatch logic Signed-off-by: Shiyu Li <shili@nvidia.com> Use cpu barrier instead of GPU at init Signed-off-by: Shiyu Li <shili@nvidia.com> Merge dispatch logic fix Signed-off-by: Shiyu Li <shili@nvidia.com> Update the kernel to use GPU-managed buffer Signed-off-by: Shiyu Li <shili@nvidia.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix issue Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean up Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Simplify AllReduce interface Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix warning Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Tidy code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Skip ut for no_fusion Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Shiyu Li <shili@nvidia.com> Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> Co-authored-by: Shiyu Li <shili@nvidia.com>		2025-05-22 03:42:36 +08:00
..
test_allreduce.py	Fallback to NCCL for various patterns when input size is large. (#4009)	2025-05-01 15:17:16 -07:00
test_ar_residual_norm.py	refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370)	2025-04-11 15:34:20 -07:00
test_embedding.py	refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370)	2025-04-11 15:34:20 -07:00
test_linear.py	refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370)	2025-04-11 15:34:20 -07:00
test_lowprecision_allreduce.py	feat: Low Precision Allreduce for PCIe based GPU (#4344)	2025-05-20 06:53:46 +08:00
test_mnnvl_allreduce.py	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
test_star_attention_input.jsonl	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_star_attention.py	Breaking change: perf: Enable scheduling overlap by default (#4174)	2025-05-15 14:27:36 +08:00
test_user_buffers.py	fix: Remove ParallelConfig. (#3678)	2025-04-21 14:14:08 +08:00