mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
* fix: EagleBuffers lifetime issue Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * refactor: Clean up Eagle kernel parameters Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * fix: Eagle draft tokens init Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Add check for updated sequence length in TrtGptModelInflightBatching Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * fix: Skip check for beam search Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> --------- Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| common.cu | ||
| common.h | ||
| eagleDecodingKernels.cu | ||
| eagleDecodingKernels.h | ||
| explicitDraftTokensKernels.cu | ||
| explicitDraftTokensKernels.h | ||
| externalDraftTokensKernels.cu | ||
| externalDraftTokensKernels.h | ||
| kvCacheUpdateKernels.cu | ||
| kvCacheUpdateKernels.h | ||
| medusaDecodingKernels.cu | ||
| medusaDecodingKernels.h | ||
| mtpKernels.cu | ||
| mtpKernels.h | ||