TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Grzegorz Kwasniewski 2101d46d68
[TRTLLM-6342][feat] TP Sharding read from the model config (#6972)
Signed-off-by: greg-kwasniewski1 <213329731+greg-kwasniewski1@users.noreply.github.com>
Co-authored-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com>
2025-08-25 15:41:27 -07:00
..
compile [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
config [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
custom_ops [None][chore] Enable auto deploy accuracy test in CI (#7179) 2025-08-24 08:42:30 -07:00
distributed [AutoDeploy] merge feat/ad-2025-07-22 (#6520) 2025-08-01 08:51:08 -07:00
export [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
models [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
shim [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
transform [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
transformations [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
utils [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
llm.py [AutoDeploy] merge feat/ad-2025-06-13 (#5556) 2025-06-29 03:52:14 +08:00