Ruoqian Guo db7446fda7 Feat: add deep_gemm swapab Kernel (#4430) ... * feat: add deepgemm_swapab feat: add fp8_gemm_kernel_swapab Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> feat: set threshold for deepgemm and deepgemmswapab Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> * docs: update README.md Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> * fix: std::runtime_error needs #include <stdexcept> Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> * chores: remove the redundant code Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> * feat: support for dense deep_gemm swapab Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> * chores: remove redundant code Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> --------- Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com> Co-authored-by: Tao Li @ NVIDIA <tali@nvidia.com>		2025-05-21 10:48:43 +08:00
..
batch_manager	refactor: Copy sequence lengths once in decoder setup (#4102)	2025-05-16 22:03:55 +08:00
common	feat: NIXL interface integration (#3934)	2025-05-19 18:18:22 +08:00
deep_gemm	Feat: add deep_gemm swapab Kernel (#4430)	2025-05-21 10:48:43 +08:00
executor	[TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936)	2025-05-21 10:40:00 +08:00
kernels	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
layers	v1.2 (#3082)	2025-03-26 23:31:29 +08:00
plugins/api	Update TensorRT-LLM (#2532)	2024-12-04 21:16:56 +08:00
runtime	fix: [nvbugs/5287097] Align PP layer distribution between pytorch and TRT flow. (#4399)	2025-05-19 14:25:36 -07:00