TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Kaiyu Xie b4e5df0ee0
Breaking change: perf: Enable scheduling overlap by default (#4174)
Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
2025-05-15 14:27:36 +08:00
..
compile feat: [AutoDeploy] generalizing cudagraph to multiple dynamic inputs (#3589) 2025-04-23 03:38:51 +08:00
custom_ops feat:[AutoDeploy] Update MoE pattern matcher to drop expert selection logic (#3283) 2025-05-15 13:53:09 +08:00
distributed [AutoDeploy] Make all ranks agree on kv-cache size (#4007) 2025-05-02 04:07:28 +08:00
models feat:[AutoDeploy] Update MoE pattern matcher to drop expert selection logic (#3283) 2025-05-15 13:53:09 +08:00
shim Breaking change: perf: Enable scheduling overlap by default (#4174) 2025-05-15 14:27:36 +08:00
transformations feat:[AutoDeploy] Update MoE pattern matcher to drop expert selection logic (#3283) 2025-05-15 13:53:09 +08:00
utils feat: [AutoDeploy] unfusing attention for native support (#3668) 2025-05-02 09:06:49 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00