TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Lucas Liebenwein 925d911fc0
[#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149)
Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
2026-02-04 09:44:27 -05:00
..
compile [None][feat] AutoDeploy: prepare_metadata revisited (#9764) 2025-12-12 20:14:14 +08:00
config [#8242][feat] Add int4 GPTQ support for AutoDeploy (#8248) 2026-01-30 23:07:24 -08:00
custom_ops [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
distributed [None][refactor] Unify the usage of MPIDist and TorchDist. (#10380) 2026-01-14 14:05:47 +08:00
export [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
models [#11086][feat] Optimize Auto Deploy weight loading by preloading weights to CPU (#11059) 2026-02-03 13:23:10 -08:00
shim [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
transform [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
utils [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00