TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Grzegorz Kwasniewski d90a8e5700
[TRTLLM-10673][feat] Improved layer classification for sharding (#10718)
Signed-off-by: greg-kwasniewski1 <213329731+greg-kwasniewski1@users.noreply.github.com>
2026-02-04 18:06:10 +01:00
..
compile [None][feat] AutoDeploy: prepare_metadata revisited (#9764) 2025-12-12 20:14:14 +08:00
config [#8242][feat] Add int4 GPTQ support for AutoDeploy (#8248) 2026-01-30 23:07:24 -08:00
custom_ops [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
distributed [None][refactor] Unify the usage of MPIDist and TorchDist. (#10380) 2026-01-14 14:05:47 +08:00
export [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
models [#11086][feat] Optimize Auto Deploy weight loading by preloading weights to CPU (#11059) 2026-02-03 13:23:10 -08:00
shim [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
transform [TRTLLM-10673][feat] Improved layer classification for sharding (#10718) 2026-02-04 18:06:10 +01:00
utils [TRTLLM-10673][feat] Improved layer classification for sharding (#10718) 2026-02-04 18:06:10 +01:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00