kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-30 07:33:48 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
43192379af
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
HuiGao-NV 43192379af
Use backend to replace macro to control enablement of MNNVL all reduce (#4635) 
Signed-off-by: Hui Gao <huig@nvidia.com>
2025-06-12 11:22:49 +08:00
..
compile [AutoDeploy]feat: Add an AutoDeploy compile backend that only calls torch.compile (#4240) 2025-05-16 08:38:15 +08:00
custom_ops [AutoDeploy] _AutoDeployLlmArgs as primary config object (#4891) 2025-06-05 17:20:55 +08:00
distributed Use backend to replace macro to control enablement of MNNVL all reduce (#4635) 2025-06-12 11:22:49 +08:00
models chore: Change the type annotations of input_ids and position_ids to int32. (#4632) 2025-06-07 16:10:47 +08:00
shim [AutoDeploy] _AutoDeployLlmArgs as primary config object (#4891) 2025-06-05 17:20:55 +08:00
transformations [AutoDeploy] Merge Feature Branch Week 3 (#5054) 2025-06-11 00:20:43 +08:00
utils [AutoDeploy] Merge Feature Branch Week 3 (#5054) 2025-06-11 00:20:43 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00