TensorRT-LLMs/cpp/tensorrt_llm/kernels/speculativeDecoding
YueWeng b1621e8d4e
feat: add relaxed acceptance for DS (#3865)
* add relaxed acceptance for DS R1

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* clean and update docs

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* Modified based on review

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix mtp manager issue

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

---------

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>
Co-authored-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
2025-05-01 21:50:36 +08:00
..
common.cu fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
common.h fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
eagleDecodingKernels.cu Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eagleDecodingKernels.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
explicitDraftTokensKernels.cu Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
explicitDraftTokensKernels.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
externalDraftTokensKernels.cu Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
externalDraftTokensKernels.h Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kvCacheUpdateKernels.cu Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
kvCacheUpdateKernels.h Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
medusaDecodingKernels.cu Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
medusaDecodingKernels.h Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
mtpKernels.cu feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00
mtpKernels.h feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00