TensorRT-LLMs/tests/unittest
Zongfei Jing c7548ad72c
perf: Add optimizations for deepseek in min latency mode (#3093)
* Add optimizations for deepseek min latency

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Fix compile error

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Update internal cutlass kernel libs

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Format code

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

* Resolve conflicts

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>

---------

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>
2025-04-02 09:05:24 +08:00
..
_torch perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
api_stability move BuildConfig functional args to llmargs (#3036) 2025-03-29 02:20:18 +08:00
bindings test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
llmapi chore: clean some ci of qa test (#3083) 2025-03-31 14:30:41 +08:00
others test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
scaffolding feat: refactor scaffolding worker and support openai api worker (#3166) 2025-04-01 18:31:52 +08:00
tools Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
trt test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
utils test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
conftest.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
dump_checkpoint_stats.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
profile_utils.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
pytest.ini test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_model_runner_cpp.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_pip_install.py relax the limitation of setuptools (#2992) 2025-03-24 13:36:10 +08:00