TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Lucas Liebenwein 97d550b4ba
[None] [AutoDeploy] canonicalize_graph before shape prop for consistent state_dict (#7223)
Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
2025-08-25 16:59:57 -04:00
..
compile [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
config [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
custom_ops [None][chore] Enable auto deploy accuracy test in CI (#7179) 2025-08-24 08:42:30 -07:00
distributed [AutoDeploy] merge feat/ad-2025-07-22 (#6520) 2025-08-01 08:51:08 -07:00
export [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
models [None][feat] Add GPT OSS support for AutoDeploy (#6641) 2025-08-12 14:03:22 -04:00
shim [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
transform [None] [AutoDeploy] canonicalize_graph before shape prop for consistent state_dict (#7223) 2025-08-25 16:59:57 -04:00
transformations [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
utils [https://nvbugs/5443039][fix] Fix AutoDeploy pattern matcher for torch 2.8 (#7076) 2025-08-21 01:14:51 -04:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [#7136][feat] trtllm-serve + autodeploy integration (#7141) 2025-08-22 08:30:53 -07:00
llm.py [AutoDeploy] merge feat/ad-2025-06-13 (#5556) 2025-06-29 03:52:14 +08:00