TensorRT-LLMs/cpp/tensorrt_llm/plugins/eaglePlugin
Robin Kobus c67da1fbaa
fix: Eagle decoding in TRT flow (#4229)
* fix: EagleBuffers lifetime issue

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* refactor: Clean up Eagle kernel parameters

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* fix: Eagle draft tokens init

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Add check for updated sequence length in TrtGptModelInflightBatching

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* fix: Skip check for beam search

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

---------

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-05-14 16:10:49 +02:00
..
CMakeLists.txt Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
eagleDecodeDraftTokensPlugin.cpp fix: Eagle decoding in TRT flow (#4229) 2025-05-14 16:10:49 +02:00
eagleDecodeDraftTokensPlugin.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
eaglePrepareDrafterInputsPlugin.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eaglePrepareDrafterInputsPlugin.h Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
eagleSampleAndAcceptDraftTokensPlugin.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eagleSampleAndAcceptDraftTokensPlugin.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00