TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Suyog Gupta e3de5758a3
[#7136][feat] trtllm-serve + autodeploy integration (#7141)
Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com>
2025-08-22 08:30:53 -07:00
..
compile [#5048][enhance] AutoDeploy: Optimize prepare_inputs (#6634) 2025-08-10 13:55:04 +03:00
config [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
custom_ops [#7136][feat] trtllm-serve + autodeploy integration (#7141) 2025-08-22 08:30:53 -07:00
distributed [AutoDeploy] merge feat/ad-2025-07-22 (#6520) 2025-08-01 08:51:08 -07:00
export [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
models [None][feat] Add GPT OSS support for AutoDeploy (#6641) 2025-08-12 14:03:22 -04:00
shim [None][opt] Add batch wait timeout in fetching requests (#6923) 2025-08-19 03:50:08 -04:00
transform [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
transformations [#4403][refactor] Move fusion, kvcache, and compile to modular inference optimizer (#7057) 2025-08-21 10:30:36 -07:00
utils [https://nvbugs/5443039][fix] Fix AutoDeploy pattern matcher for torch 2.8 (#7076) 2025-08-21 01:14:51 -04:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [#7136][feat] trtllm-serve + autodeploy integration (#7141) 2025-08-22 08:30:53 -07:00
llm.py [AutoDeploy] merge feat/ad-2025-06-13 (#5556) 2025-06-29 03:52:14 +08:00