TensorRT-LLMs/cpp/tests/executor
Robin Kobus b7a38feb14
chore: Clean up cpp runtime (#3537)
* add space in test output

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* perf: reduce executor lock scope

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* refactor: Move TokenRangeRetentionConfig implementation to cpp file

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* fix: Improve finished steps handling for external draft tokens

- Fixed a bug where the whole finished steps tensor was being zeroes instead of the slices.
- Replaced the creation of a temporary tensor for finished steps with a direct slice from the input tensor, improving efficiency and readability.
- Updated the tensor management logic to streamline the process of setting zero values for finished steps during batch processing.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Clean up includes

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

---------

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-04-15 16:06:14 +08:00
..
CMakeLists.txt Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
disaggExecutor.h conditional disagg test (#3012) 2025-03-26 15:55:33 +08:00
disaggExecutorTest.cpp fix: conditional disagg test name (#3161) 2025-04-02 15:34:30 +08:00
encDecTest.cpp chore: Clean up cpp runtime (#3537) 2025-04-15 16:06:14 +08:00
executorMockTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executorTest.cpp Port multi GPU changes to GitHub (#3027) 2025-03-27 05:55:03 +08:00
executorTest.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00