Zongfei Jing dbaddb3a29 Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216) ... * Adding two-shot allreduce kernel and mnnvl multicasting buffergit gffe Signed-off-by: Shiyu Li <shili@nvidia.com> Adding comments Signed-off-by: Shiyu Li <shili@nvidia.com> Add unittest of the twoshot kernel. Signed-off-by: Shiyu Li <shili@nvidia.com> Update dispatch logic Signed-off-by: Shiyu Li <shili@nvidia.com> Use cpu barrier instead of GPU at init Signed-off-by: Shiyu Li <shili@nvidia.com> Merge dispatch logic fix Signed-off-by: Shiyu Li <shili@nvidia.com> Update the kernel to use GPU-managed buffer Signed-off-by: Shiyu Li <shili@nvidia.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix issue Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Clean up Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Simplify AllReduce interface Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix warning Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Tidy code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Rename Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Skip ut for no_fusion Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Refine Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Shiyu Li <shili@nvidia.com> Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> Co-authored-by: Shiyu Li <shili@nvidia.com>		2025-05-22 03:42:36 +08:00
..
_torch	Adding two-shot allreduce kernel and mnnvl multicasting buffer (#4216)	2025-05-22 03:42:36 +08:00
api_stability	[TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936)	2025-05-21 10:40:00 +08:00
bindings	feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384)	2025-05-20 17:53:48 +08:00
disaggregated	feat: conditional disaggregation in disagg server (#3974)	2025-05-21 09:57:46 +08:00
llmapi	fix[nvbug/5286515]: trtllm-llmapi-launch on single node single gpu (#4428)	2025-05-20 20:16:14 +08:00
others	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
scaffolding	[TRTLLM-4638] feat(scaffolding): update Reward Controller to PRM specific controller with step split (#4337)	2025-05-19 17:53:41 +08:00
tools	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
trt	[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper (#4123)	2025-05-14 15:48:07 +08:00
utils	add changes for fp8, nemotron-nas, API (#4180)	2025-05-18 23:27:25 +08:00
conftest.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00
dump_checkpoint_stats.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
profile_utils.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
pytest.ini	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_model_runner_cpp.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_pip_install.py	relax the limitation of setuptools (#2992)	2025-03-24 13:36:10 +08:00