TensorRT-LLMs/tests/unittest/_torch/thop
Zongfei Jing c7548ad72c
perf: Add optimizations for deepseek in min latency mode (#3093)
* Add optimizations for deepseek min latency

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Fix compile error

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Update internal cutlass kernel libs

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Format code

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Resolve conflicts

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

---------

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>
2025-04-02 09:05:24 +08:00
..
test_cublas_mm.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_logits_bitmask_op.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_mamba_conv1d_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_moe_op.py perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
test_noaux_tc.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_scaled_mm.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_selective_scan_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00