TensorRT-LLMs/tensorrt_llm/_torch/auto_deploy
Lucas Liebenwein 991e507e11
[https://nvbugs/5642736][fix] fix AutoDeploy pattern matcher for torch 2.9 (#8920) (#8958)
Signed-off-by: Fridah-nv <201670829+Fridah-nv@users.noreply.github.com>
Co-authored-by: Frida Hou <201670829+Fridah-nv@users.noreply.github.com>
2025-11-06 10:21:32 -08:00
..
compile [https://nvbugs/5606166][fix] AutoDeploy: use tuples for cudagraph shape lookup (#8772) 2025-10-31 13:59:48 +01:00
config [TRTLLM-6342][feat] Support for partial sharding from factory (#7393) 2025-09-19 09:07:42 -07:00
custom_ops [None][doc] Rename TensorRT-LLM to TensorRT LLM for homepage and the … (#7850) 2025-09-25 21:02:35 +08:00
distributed [#7308] [feat] AutoDeploy: graph-less transformers mode for HF (#7635) 2025-09-18 10:44:24 +08:00
export [https://nvbugs/5642736][fix] fix AutoDeploy pattern matcher for torch 2.9 (#8920) (#8958) 2025-11-06 10:21:32 -08:00
models [#7308] [feat] AutoDeploy: graph-less transformers mode for HF (#7635) 2025-09-18 10:44:24 +08:00
shim [https://nvbugs/5570599][fix] Set KVCache free_gpu_memory_fraction fo… (#8780) 2025-11-06 05:58:07 -08:00
transform [TRTLLM-6342][feat] Support for partial sharding from factory (#7393) 2025-09-19 09:07:42 -07:00
transformations [#7308] [feat] AutoDeploy: graph-less transformers mode for HF (#7635) 2025-09-18 10:44:24 +08:00
utils [TRTLLM-6342][feat] Support for partial sharding from factory (#7393) 2025-09-19 09:07:42 -07:00
__init__.py [AutoDeploy] merge feat/ad-2025-07-07 (#6196) 2025-07-23 05:11:04 +08:00
llm_args.py [TRTLLM-7728][feat] batched sampling by strategy (supersedes enable_mixed_sampler, cf. TRTLLM-7156) (#7294) 2025-09-23 16:05:05 -07:00
llm.py [None][fix] Read eos_token_id from generation_config for kimi_k2 (#7120) 2025-09-23 10:47:03 +08:00