kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
6cbeb7724b
TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
History
Lucas Liebenwein de409e8468
[AutoDeploy] HF factory improvements (#4371) 
* [AutoDeploy] HF factory improvements

Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>

* improve monkey-patches and add unit tests

Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>

---------

Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
2025-05-19 20:13:43 -07:00
..
compile [AutoDeploy]feat: Add an AutoDeploy compile backend that only calls torch.compile (#4240) 2025-05-16 08:38:15 +08:00
custom_ops perf: Eliminate the need for attention DP padding when possible (#3439) 2025-05-17 13:30:55 +08:00
distributed perf: Eliminate the need for attention DP padding when possible (#3439) 2025-05-17 13:30:55 +08:00
models [AutoDeploy] HF factory improvements (#4371) 2025-05-19 20:13:43 -07:00
shim [AutoDeploy] HF factory improvements (#4371) 2025-05-19 20:13:43 -07:00
transformations [AutoDeploy] HF factory improvements (#4371) 2025-05-19 20:13:43 -07:00
utils feat: [AutoDeploy] update rope matcher with minor variants (Deepseek) (#3638) 2025-05-16 09:55:32 -04:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00