Zongfei Jing c7548ad72c perf: Add optimizations for deepseek in min latency mode (#3093) ... * Add optimizations for deepseek min latency Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Fix compile error Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Update internal cutlass kernel libs Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Format code Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * Resolve conflicts Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>		2025-04-02 09:05:24 +08:00
..
batch_manager	refactor: Simplify disableLookahead and improve numDecodingEngineTokens handling (#3103)	2025-04-01 18:47:31 +08:00
common	fix: fix for cp > kvHeadNum (#3002)	2025-03-26 12:39:02 +08:00
cutlass_extensions/include/cutlass_extensions	feat: Update cutlass (#2981)	2025-03-26 22:36:27 +08:00
executor	feat: Add BW measurement (#3070)	2025-03-28 10:53:00 +08:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
layers	v1.2 (#3082)	2025-03-26 23:31:29 +08:00
plugins	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
pybind	Revert "refactor: Replace DecoderFinishedEvent with CudaEvent in decoder clas…" (#3183)	2025-04-01 12:49:27 +08:00
runtime	refactor: Simplify disableLookahead and improve numDecodingEngineTokens handling (#3103)	2025-04-01 18:47:31 +08:00
thop	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
CMakeLists.txt	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00