TensorRT-LLMs/cpp/include/tensorrt_llm/deep_gemm
Ruoqian Guo db7446fda7
Feat: add deep_gemm swapab Kernel (#4430)
* feat: add deepgemm_swapab

feat: add fp8_gemm_kernel_swapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

feat: set threshold for deepgemm and deepgemmswapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* docs: update README.md

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* fix: std::runtime_error needs #include <stdexcept>

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* chores: remove the redundant code

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* feat: support for dense deep_gemm swapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* chores: remove redundant code

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

---------

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>
Co-authored-by: Tao Li @ NVIDIA <tali@nvidia.com>
2025-05-21 10:48:43 +08:00
..
compiler.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
fp8_gemm_impl.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
fp8_gemm.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
jit_utils.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
mma_utils.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
nvrtc_cutlass.cuh feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
nvrtc_std.cuh feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
runtime.cuh feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00
scheduler.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
tma_utils.cuh Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
utils.cuh feat: use NVRTC for DeepGEMM JIT compilation (#3239) 2025-04-07 20:29:23 +08:00