kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-25 13:12:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
6b583f6f83
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Jinyang Yuan 6b583f6f83
perf: Enable CUDA graphs when attention DP is used and active requests on different GPUs are uneven (#3010) 
Signed-off-by: Jinyang Yuan <154768711+jinyangyuan-nvidia@users.noreply.github.com>
Co-authored-by: raccoonliukai <raccoonliu@tencent.com>
2025-03-26 21:09:25 +08:00
..
compile Update (#2978) 2025-03-23 16:39:35 +08:00
custom_ops Refactor imports inside tensorrt_llm._torch. (#3015) 2025-03-26 11:01:07 +08:00
distributed Refactor imports inside tensorrt_llm._torch. (#3015) 2025-03-26 11:01:07 +08:00
models Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
shim perf: Enable CUDA graphs when attention DP is used and active requests on different GPUs are uneven (#3010) 2025-03-26 21:09:25 +08:00
transformations Update (#2978) 2025-03-23 16:39:35 +08:00
utils Refactor imports inside tensorrt_llm._torch. (#3015) 2025-03-26 11:01:07 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00