TensorRT-LLMs/tensorrt_llm/_torch/speculative
YueWeng b1621e8d4e
feat: add relaxed acceptance for DS (#3865)
* add relaxed acceptance for DS R1

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* clean and update docs

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* Modified based on review

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

* fix mtp manager issue

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>

---------

Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>
Co-authored-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
2025-05-01 21:50:36 +08:00
..
__init__.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
eagle3.py [fix] Fix flashinfer + speculation issues (#3686) 2025-04-28 14:34:22 -04:00
interface.py [fix] Pad requests to maximum draft length in spec decode (#3957) 2025-04-30 11:02:18 -04:00
mtp.py feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00
utils.py feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00