kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
20b69a982a
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Ziyi Xiong 70b4d282c6
[TRTLLM-7736][feat] Incrementally update the inputs of target and draft models (#9708) 
Signed-off-by: ziyixiong-nv <219238287+ziyixiong-nv@users.noreply.github.com>
2025-12-19 15:11:25 +08:00
..
compile [None][feat] AutoDeploy: prepare_metadata revisited (#9764) 2025-12-12 20:14:14 +08:00
config [#7532][feat] AutoDeploy: gather logits before lm head (#9962) 2025-12-17 19:50:13 -08:00
custom_ops [#9230][refactor] Replace nemotron patches with custom model implementation (#9751) 2025-12-18 19:36:27 -08:00
distributed [#9198][feat] Refactor dist ops in AutoDeploy (#9301) 2025-12-02 02:36:32 +08:00
export [#9230][feat] Slimmed down implementation of nemotron H (#9235) 2025-11-23 03:13:32 -08:00
models [#9230][refactor] Replace nemotron patches with custom model implementation (#9751) 2025-12-18 19:36:27 -08:00
shim [TRTLLM-7736][feat] Incrementally update the inputs of target and draft models (#9708) 2025-12-19 15:11:25 +08:00
transform [#9230][refactor] Replace nemotron patches with custom model implementation (#9751) 2025-12-18 19:36:27 -08:00
utils [TRTLLM-9136][feat] 2D parallel EP TP support (#9459) 2025-12-15 09:52:29 +01:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [None][feat] AutoDeploy: prepare_metadata revisited (#9764) 2025-12-12 20:14:14 +08:00
llm.py [TRTLLM-9065][chore] remove PyTorchConfig completely (#8856) 2025-11-06 22:37:03 -08:00