TensorRT-LLMs/cpp/tensorrt_llm/kernels/decoderMaskedMultiheadAttention/decoderXQAImplJIT
Perkz Zheng 35c5e4f1c5
feat: add CGA reduction fmha kernels on Blackwell. (#3763)
* update cubins

Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>

* add trtllm-gen kernels for eagle3 and also kernels with cga-reduction

Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>

* address the comments

Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>

---------

Signed-off-by: Perkz Zheng <67892460+PerkzZheng@users.noreply.github.com>
2025-04-29 10:43:54 +08:00
..
nvrtcWrapper Revert "infra: move nvrtc_wrapper to conan (#3282)" (#3573) 2025-04-15 22:45:13 +08:00
compileEngine.cpp Revert "infra: move nvrtc_wrapper to conan (#3282)" (#3573) 2025-04-15 22:45:13 +08:00
compileEngine.h refactor: Clean up CMakeLists.txt (#3479) 2025-04-18 14:39:29 +08:00
cubinObj.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cubinObj.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
cubinObjRegistry.h fix: segfault in cudaDriverWrapper (#3017) 2025-04-02 08:55:19 +02:00
decoderXQAImplJIT.cpp feat: add CGA reduction fmha kernels on Blackwell. (#3763) 2025-04-29 10:43:54 +08:00
decoderXQAImplJIT.h Support speculative decoding with Hopper XQA (#3269) 2025-04-07 17:14:34 +08:00
kernelUtils.cpp Support speculative decoding with Hopper XQA (#3269) 2025-04-07 17:14:34 +08:00
kernelUtils.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
serializationUtils.h Update TensorRT-LLM (#1554) 2024-05-07 23:34:28 +08:00