Yukun He a1645c922b Fallback to NCCL for various patterns when input size is large. (#4009) ... When input size is larger than the max workspace size, we shall fallback to NCCL + corresponding pre/post function to ensure the functionality of AllReduce. Signed-off-by: Yukun He <23156053+hyukn@users.noreply.github.com>		2025-05-01 15:17:16 -07:00
..
_torch	Fallback to NCCL for various patterns when input size is large. (#4009)	2025-05-01 15:17:16 -07:00
api_stability	feat: LogitsProcessor in PyTorch backend (#3145)	2025-05-01 14:15:30 -07:00
bindings	feat: Add multimodal embedding field in LlmRequest (#3855)	2025-05-01 12:23:30 +08:00
disaggregated	feat: Disaggregated router class (#3584)	2025-04-19 00:34:12 +08:00
llmapi	feat: LogitsProcessor in PyTorch backend (#3145)	2025-05-01 14:15:30 -07:00
others	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
scaffolding	[TRTLLM-4638 ][feat] add best of n support with reward model in scaffolding (#3807)	2025-04-28 17:15:33 +08:00
tools	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
trt	Unify two versions of AllReduce custom op (#3032)	2025-04-22 21:58:42 +08:00
utils	TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770)	2025-04-29 11:19:11 -04:00
conftest.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00
dump_checkpoint_stats.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
profile_utils.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
pytest.ini	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_model_runner_cpp.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_pip_install.py	relax the limitation of setuptools (#2992)	2025-03-24 13:36:10 +08:00