TensorRT-LLMs/cpp/tensorrt_llm/kernels/speculativeDecoding
Robin Kobus c67da1fbaa
fix: Eagle decoding in TRT flow (#4229)
* fix: EagleBuffers lifetime issue

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* refactor: Clean up Eagle kernel parameters

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* fix: Eagle draft tokens init

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Add check for updated sequence length in TrtGptModelInflightBatching

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* fix: Skip check for beam search

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

---------

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-05-14 16:10:49 +02:00
..
common.cu fix: Eagle decoding in TRT flow (#4229) 2025-05-14 16:10:49 +02:00
common.h fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
eagleDecodingKernels.cu fix: Eagle decoding in TRT flow (#4229) 2025-05-14 16:10:49 +02:00
eagleDecodingKernels.h fix: Eagle decoding in TRT flow (#4229) 2025-05-14 16:10:49 +02:00
explicitDraftTokensKernels.cu Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
explicitDraftTokensKernels.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
externalDraftTokensKernels.cu Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
externalDraftTokensKernels.h Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kvCacheUpdateKernels.cu Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
kvCacheUpdateKernels.h Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
medusaDecodingKernels.cu Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
medusaDecodingKernels.h Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
mtpKernels.cu feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00
mtpKernels.h feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00