TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Grzegorz Kwasniewski 0a7a88e74e
[TRTLLM-8946][feat] Improved heuristics to detect shardable regions (#9200)
Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
Signed-off-by: greg-kwasniewski1 <213329731+greg-kwasniewski1@users.noreply.github.com>
Co-authored-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
2025-12-02 22:08:19 +01:00
..
compile [None][feat] Autodeploy add triton configs and optimize mamba prefill (#9083) 2025-11-13 19:15:43 -08:00
config [#9198][feat] Refactor dist ops in AutoDeploy (#9301) 2025-12-02 02:36:32 +08:00
custom_ops [#9550][feat] AutoDeploy: Add NVFP4 Cutlass MoE kernels (#9551) 2025-12-03 01:39:38 +08:00
distributed [#9198][feat] Refactor dist ops in AutoDeploy (#9301) 2025-12-02 02:36:32 +08:00
export [#9230][feat] Slimmed down implementation of nemotron H (#9235) 2025-11-23 03:13:32 -08:00
models [TRTLLM-8946][feat] Improved heuristics to detect shardable regions (#9200) 2025-12-02 22:08:19 +01:00
shim [TRTLLM-6756][feat] Add Beam Search to TorchSampler (#8509) 2025-12-01 18:48:04 +01:00
transform [TRTLLM-8946][feat] Improved heuristics to detect shardable regions (#9200) 2025-12-02 22:08:19 +01:00
utils [TRTLLM-8946][feat] Improved heuristics to detect shardable regions (#9200) 2025-12-02 22:08:19 +01:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [#9237][feat] enable iter stats in autodeploy (#9278) 2025-11-19 19:29:29 +01:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00