TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Xiwen Yu 38ef850552 Merge remote-tracking branch 'gitlab/main' into user/xiweny/merge_0901
Signed-off-by: Xiwen Yu <13230610+VALLIS-NERIA@users.noreply.github.com>
2025-09-01 11:46:44 +08:00
..
compile [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
config [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
custom_ops update cutlass and DeepGEMM 2025-08-26 22:43:39 -07:00
distributed [AutoDeploy] merge feat/ad-2025-07-22 (#6520) 2025-08-01 08:51:08 -07:00
export [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
models [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
shim [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
transform [None][doc] Update autodeploy README.md, deprecate lm_eval in examples folder (#7233) 2025-08-26 10:47:57 -07:00
transformations [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
utils [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [TRTLLM-6342][feat] TP Sharding read from the model config (#6972) 2025-08-25 15:41:27 -07:00
llm.py [AutoDeploy] merge feat/ad-2025-06-13 (#5556) 2025-06-29 03:52:14 +08:00