Robin Kobus 3c3629c52a refactor: simplify forward methods in GptDecoderBatched (#3076) ... * refactor: Remove ForwardType enum from GptDecoderBatched - Remove ForwardType enum from GptDecoderBatched - Simplify forwardDispatch and forwardDecoder methods Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * refactor: Remove forwardDecoder method from GptDecoderBatched - Eliminate the forwardDecoder method to streamline the decoding process. - Update forwardDispatch to directly call forwardAsync when input batch size is greater than zero. Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * refactor: Move event handling from forwardDispatch to forwardAsync Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> --------- Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>		2025-03-26 20:45:04 +08:00
..
batch_manager	Add updateKVCacheTransfer (#2984)	2025-03-25 21:45:35 +08:00
common	fix: fix for cp > kvHeadNum (#3002)	2025-03-26 12:39:02 +08:00
cutlass_extensions/include/cutlass_extensions	Update (#2978)	2025-03-23 16:39:35 +08:00
executor	Update (#2978)	2025-03-23 16:39:35 +08:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	bitmask v3 (#3009)	2025-03-26 15:21:29 +08:00
layers	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
plugins	fix: fix for cp > kvHeadNum (#3002)	2025-03-26 12:39:02 +08:00
pybind	fix: disable kv cache reuse when minimum window size is reached, instead of maximum window size (#2983)	2025-03-24 22:49:52 +08:00
runtime	refactor: simplify forward methods in GptDecoderBatched (#3076)	2025-03-26 20:45:04 +08:00
thop	Update (#2978)	2025-03-23 16:39:35 +08:00
CMakeLists.txt	Update TensorRT-LLM (#2936)	2025-03-18 21:25:19 +08:00