kanghui0204 6f3922f318 feat: Low Precision Allreduce for PCIe based GPU (#4344) ... This PR adds a customized allreduce to TensorRT-LLM. The new allreduce is used for communication on PCIe-based GPUs via low-precision quantization, which can accelerate the PCIe allreduce process. Signed-off-by: Hui Kang <hkang@nvidia.com> Co-authored-by: Hui Kang <hkang@nvidia.com>		2025-05-20 06:53:46 +08:00
..
_torch	feat: Low Precision Allreduce for PCIe based GPU (#4344)	2025-05-20 06:53:46 +08:00
api_stability	add changes for fp8, nemotron-nas, API (#4180)	2025-05-18 23:27:25 +08:00
bindings	refactor: use x is None instead of x == None. (#4244)	2025-05-15 20:00:04 +08:00
disaggregated	feat: add kv cache aware router (#3831)	2025-05-12 07:23:57 -04:00
llmapi	chore: cleanup perf_evaluator code (#3833)	2025-05-19 13:21:36 +08:00
others	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
scaffolding	[TRTLLM-4638] feat(scaffolding): update Reward Controller to PRM specific controller with step split (#4337)	2025-05-19 17:53:41 +08:00
tools	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
trt	[TRTLLM-3330][feat] Support DeepSeek-R1 W4A8 on Hopper (#4123)	2025-05-14 15:48:07 +08:00
utils	add changes for fp8, nemotron-nas, API (#4180)	2025-05-18 23:27:25 +08:00
conftest.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00
dump_checkpoint_stats.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
profile_utils.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
pytest.ini	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_model_runner_cpp.py	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
test_pip_install.py	relax the limitation of setuptools (#2992)	2025-03-24 13:36:10 +08:00