TensorRT-LLMs/cpp
Robin Kobus 3ee4332fb1
refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078)
- Updated the `forwardAsync` method in `GptDecoderBatched` and `iGptDecoderBatched` to return `CudaEvent` instead of `DecoderFinishedEventPtr`, simplifying event handling.
- Removed the `DecoderFinishedEvent` class and its associated usage across various files, streamlining the codebase.
- Adjusted related methods and Python bindings to accommodate the new event structure, ensuring compatibility and maintaining functionality.

These changes enhance the clarity and efficiency of the decoding process in the batch manager.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-03-28 14:50:52 +08:00
..
cmake Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
include/tensorrt_llm refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) 2025-03-28 14:50:52 +08:00
micro_benchmarks Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
tensorrt_llm refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) 2025-03-28 14:50:52 +08:00
tests refactor: Improve decoder finalize function (#3077) 2025-03-28 14:33:59 +08:00
CMakeLists.txt Update (#2978) 2025-03-23 16:39:35 +08:00