kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
b77f4ffe54
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Grzegorz Kwasniewski cff54fcae3
[#8948][feat] Support custom sharding config (#9143) 
Signed-off-by: greg-kwasniewski1 <213329731+greg-kwasniewski1@users.noreply.github.com>
2025-11-29 05:28:05 +08:00
..
compile [None][feat] Autodeploy add triton configs and optimize mamba prefill (#9083) 2025-11-13 19:15:43 -08:00
config [#8948][feat] Support custom sharding config (#9143) 2025-11-29 05:28:05 +08:00
custom_ops [#9150][feat] AutoDeploy Nemotron-Flash support (#9504) 2025-11-27 18:03:57 +01:00
distributed [https://nvbugs/5647400] [fix] Enlarged the AllReduce workspace size to 64MB. Added AllReduce strategy to AD config. (#9145) 2025-11-25 10:56:07 -08:00
export [#9230][feat] Slimmed down implementation of nemotron H (#9235) 2025-11-23 03:13:32 -08:00
models [#9150][feat] AutoDeploy Nemotron-Flash support (#9504) 2025-11-27 18:03:57 +01:00
shim [#9237][feat] enable iter stats in autodeploy (#9278) 2025-11-19 19:29:29 +01:00
transform [#8948][feat] Support custom sharding config (#9143) 2025-11-29 05:28:05 +08:00
utils [#8948][feat] Support custom sharding config (#9143) 2025-11-29 05:28:05 +08:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [#9237][feat] enable iter stats in autodeploy (#9278) 2025-11-19 19:29:29 +01:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00