Zongfei Jing c7548ad72c perf: Add optimizations for deepseek in min latency mode (#3093) ... * Add optimizations for deepseek min latency Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Update internal cutlass kernel libs Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Format code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Resolve conflicts Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>		2025-04-02 09:05:24 +08:00
..
allgatherOp.cpp	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
allreduceOp.cpp	None - Add one-shot version for UB AR NORM FP16/BF16 (#2995)	2025-03-31 11:16:03 +08:00
attentionOp.cpp	fix：fix illeagel memory access when mtp >= 2 (#3006)	2025-04-01 13:36:45 +08:00
CMakeLists.txt	Update (#2978)	2025-03-23 16:39:35 +08:00
convertSpecDecodingMaskToPackedMaskOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
cublasScaledMM.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
cutlassScaledMM.cpp	Update TensorRT-LLM (#2582)	2024-12-16 21:50:47 -08:00
deepseekAllreduceFusionOp.cpp	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
dynamicDecodeOp.cpp	v1.2 (#3082)	2025-03-26 23:31:29 +08:00
dynamicDecodeOp.h	Update TensorRT-LLM (#2783)	2025-02-13 18:40:22 +08:00
fmhaPackMaskOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
fp4BatchedQuantize.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
fp4Gemm.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
fp4Op.cpp	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00
fp4Quantize.cpp	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
fp8BlockScaleMoe.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
fp8BlockScalingGemm.cpp	fix: Update FP8 sf layout for Blackwell and relax blockwise GEMM assertions (#3144)	2025-04-01 13:08:29 -07:00
fp8Op.cpp	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
fp8Quantize.cpp	fix: Update FP8 sf layout for Blackwell and relax blockwise GEMM assertions (#3144)	2025-04-01 13:08:29 -07:00
gatherTreeOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
logitsBitmaskOp.cpp	Update (#2978)	2025-03-23 16:39:35 +08:00
mambaConv1dOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
moeOp.cpp	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
mtpOp.cpp	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
ncclCommunicatorOp.cpp	Update TensorRT-LLM (#941)	2024-01-23 23:22:35 +08:00
ncclCommunicatorOp.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
noAuxTcOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
parallelDecodeKVCacheUpdateOp.cpp	Update TensorRT-LLM (#2582)	2024-12-16 21:50:47 -08:00
redrafterCurandOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
reducescatterOp.cpp	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
relativeAttentionBiasOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
selectiveScanOp.cpp	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
thUtils.cpp	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
thUtils.h	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00
userbuffersFinalizeOp.cpp	Update (#2978)	2025-03-23 16:39:35 +08:00
weightOnlyQuantOp.cpp	Update TensorRT-LLM (#2849)	2025-03-04 18:44:00 +08:00