TensorRT-LLMs/cpp/tensorrt_llm
Jhao-Ting Chen 6edaa23c1c
[None][feat] Multi-block mode for Hopper spec dec XQA kernel (#4416)
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
2025-08-03 14:31:33 -07:00
..
batch_manager use cudaSetDevice to create context ,fix nvbug 5394497 (#6403) 2025-08-03 13:32:55 -04:00
common [None][feat] Multi-block mode for Hopper spec dec XQA kernel (#4416) 2025-08-03 14:31:33 -07:00
cutlass_extensions/include/cutlass_extensions Fix GEMM+AR fusion on blackwell (#5563) 2025-07-09 08:48:47 +08:00
deep_ep DeepEP LL dispatch FP4 (#6296) 2025-07-28 11:25:42 +08:00
executor feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels [None][feat] Multi-block mode for Hopper spec dec XQA kernel (#4416) 2025-08-03 14:31:33 -07:00
layers refactor: Remove enforced sorted order of batch slots (#3502) 2025-07-14 17:23:02 +02:00
nanobind [None][refactor] Simplify finish reasons handling in DecoderState (#6524) 2025-08-02 07:17:43 +02:00
plugins [None][feat] Multi-block mode for Hopper spec dec XQA kernel (#4416) 2025-08-03 14:31:33 -07:00
pybind [None][refactor] Simplify finish reasons handling in DecoderState (#6524) 2025-08-02 07:17:43 +02:00
runtime [None][refactor] Simplify finish reasons handling in DecoderState (#6524) 2025-08-02 07:17:43 +02:00
testing fix: Improve chunking test and skip empty kernel calls (#5710) 2025-07-04 09:08:15 +02:00
thop [None][feat] Multi-block mode for Hopper spec dec XQA kernel (#4416) 2025-08-03 14:31:33 -07:00
CMakeLists.txt feat: binding type build argument (pybind, nanobind) (#5802) 2025-07-11 00:48:50 +09:00