TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Suyog Gupta f3d784c6f6
[#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520)
Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com>
2026-02-15 15:07:56 -08:00
..
compile [None][feat] AutoDeploy: prepare_metadata revisited (#9764) 2025-12-12 20:14:14 +08:00
config [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
custom_ops [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
distributed [None][refactor] Unify the usage of MPIDist and TorchDist. (#10380) 2026-01-14 14:05:47 +08:00
export [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
models [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
shim [#10966][feat] AutoDeploy: kv cache manager integration [2/2] (#11149) 2026-02-04 09:44:27 -05:00
transform [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
utils [#10345][perf] Enable multi-stream MOE for super. Also adds multi-stream MLA attn (#11520) 2026-02-15 15:07:56 -08:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [None][feat] Export ONNX for DriveOS LLM (#10117) 2026-01-30 15:43:11 -05:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00