TensorRT-LLMs/tensorrt_llm/_torch/compilation
Jin Li 6631791c60
[https://nvbugs/5546510][fix] Move torch.cuda.Stream out of torch com… (#8494)
Signed-off-by: Jin Li <59594262+liji-nv@users.noreply.github.com>
2025-10-22 11:21:58 +08:00
..
multi_stream [TRTLLM-4279] feat: Multistream initial support for torch compile flow (#5847) 2025-07-21 19:10:22 +08:00
patterns feat: Add non UB AR + Residual + Norm + Quant fusion (#6320) 2025-07-24 05:51:43 -04:00
__init__.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
backend.py [https://nvbugs/5546510][fix] Move torch.cuda.Stream out of torch com… (#8494) 2025-10-22 11:21:58 +08:00
piecewise_optimizer.py [None][chore] Mass integration of release/1.0 - 3rd (#7519) 2025-09-08 14:03:04 +08:00
recover_pass.py [TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804) 2025-05-09 11:04:01 +08:00
remove_copy_pass.py [TRTLLM-4279] feat: Multistream initial support for torch compile flow (#5847) 2025-07-21 19:10:22 +08:00
utils.py [TRTLLM-7027][feat] Fuse d2t to logitsBitmaskKernel and fix a race condition in one-model spec (#7481) 2025-09-04 23:30:14 +08:00