8 Commits

Author	SHA1	Message	Date
Robin Kobus	3ee4332fb1	refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) ... - Updated the `forwardAsync` method in `GptDecoderBatched` and `iGptDecoderBatched` to return `CudaEvent` instead of `DecoderFinishedEventPtr`, simplifying event handling. - Removed the `DecoderFinishedEvent` class and its associated usage across various files, streamlining the codebase. - Adjusted related methods and Python bindings to accommodate the new event structure, ensuring compatibility and maintaining functionality. These changes enhance the clarity and efficiency of the decoding process in the batch manager. Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>	2025-03-28 14:50:52 +08:00
Kaiyu Xie	2631f21089	Update (#2978) ... Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>	2025-03-23 16:39:35 +08:00
Kaiyu Xie	3aa6b11d13	Update TensorRT-LLM (#2936) ... * Update TensorRT-LLM --------- Co-authored-by: changcui <cuichang147@gmail.com>	2025-03-18 21:25:19 +08:00
Kaiyu Xie	9b931c0f63	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
Kaiyu Xie	ab5b19e027	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
Dan Blanaru	16d2467ea8	Update TensorRT-LLM (#2755) ... * Update TensorRT-LLM --------- Co-authored-by: Denis Kayshev <topenkoff@gmail.com> Co-authored-by: akhoroshev <arthoroshev@gmail.com> Co-authored-by: Patrick Reiter Horn <patrick.horn@gmail.com> Update	2025-02-11 03:01:00 +00:00
Kaiyu Xie	c629546ce4	Update TensorRT-LLM (#2436)	2024-11-12 15:27:49 +08:00
Kaiyu Xie	b7868dd1bd	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00