kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
c19b7f7c2a
TensorRT-LLMs/cpp/tensorrt_llm/kernels/internal_cutlass_kernels
History
Zongfei Jing c7548ad72c
perf: Add optimizations for deepseek in min latency mode (#3093) 
* Add optimizations for deepseek min latency

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Fix compile error

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Update internal cutlass kernel libs

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Format code

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Resolve conflicts

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

---------

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>
2025-04-02 09:05:24 +08:00
..
aarch64-linux-gnu perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
include perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
x86_64-linux-gnu perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00