kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
b15f57763d
TensorRT-LLMs/docs/source
History
kanghui0204 5e634dd1bd
feat: Low Precision Allreduce for PCIe based GPU (#3851) 
This PR adds a customized allreduce to TensorRT-LLM. The new allreduce is used for communication on PCIe-based GPUs via low-precision quantization, which can accelerate the PCIe allreduce process.

Signed-off-by: Hui Kang <hkang@nvidia.com>
Co-authored-by: Hui Kang <hkang@nvidia.com>
2025-05-14 16:45:43 +08:00
..
_static doc: update switcher.json config (#4220) 2025-05-12 20:40:55 +08:00
_templates Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
advanced feat: Low Precision Allreduce for PCIe based GPU (#3851) 2025-05-14 16:45:43 +08:00
architecture doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
blogs chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00
commands feat: trtllm-serve multimodal support (#3590) 2025-04-19 05:01:28 +08:00
dev-on-cloud doc: add doc ahout developent on cloud or runpod (#3194) 2025-04-02 18:10:56 +08:00
examples doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
installation relax the limitation of setuptools (#2992) 2025-03-24 13:36:10 +08:00
llm-api doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
media L4 added to readme (#3301) 2025-04-06 19:09:28 +08:00
performance doc: TRTLLM-4797 Update perf-analysis.md (#4100) 2025-05-08 17:24:44 +08:00
python-api Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
reference [Infra][TRTLLM-4374] Upgrade TRT 10.10.0 GA, CUDA 12.9 GA and DLFW 25.04 (#4049) 2025-05-13 14:59:12 +08:00
torch Remove dummy forward path (#3669) 2025-04-18 16:17:50 +08:00
conf.py doc: update switcher.json config (#4220) 2025-05-12 20:40:55 +08:00
helper.py doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
index.rst doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
key-features.md Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
overview.md chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00
quick-start-guide.md doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
release-notes.md chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00
torch.md chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00