TensorRT-LLMs/tensorrt_llm/_torch/speculative
Fanrong Li 77f8e43592
[fix] Fix relaxed acceptance to support enabling it in context phase (#4126)
* fix relaxed acceptance to support enable this feature in context phase.

Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>

* fix sample_and_accept_draft_tokens unit test.

Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>

---------

Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
2025-05-09 14:11:14 +08:00
..
__init__.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
eagle3.py [fix] Fix flashinfer + speculation issues (#3686) 2025-04-28 14:34:22 -04:00
interface.py [fix] Pad requests to maximum draft length in spec decode (#3957) 2025-04-30 11:02:18 -04:00
mtp.py [fix] Fix relaxed acceptance to support enabling it in context phase (#4126) 2025-05-09 14:11:14 +08:00
utils.py feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00