TensorRT-LLMs/cpp/tests/unit_tests
Zongfei Jing c7548ad72c
perf: Add optimizations for deepseek in min latency mode (#3093)
* Add optimizations for deepseek min latency

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Fix compile error

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Update internal cutlass kernel libs

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Format code

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Resolve conflicts

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

---------

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>
2025-04-02 09:05:24 +08:00
..
batch_manager fix: disable kv cache reuse when minimum window size is reached, instead of maximum window size (#2983) 2025-03-24 22:49:52 +08:00
common Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
executor feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
kernels perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
layers Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
runtime v1.2 (#3082) 2025-03-26 23:31:29 +08:00
thop Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
utils Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
CMakeLists.txt Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00