TensorRT-LLMs/tensorrt_llm/_torch/speculative
yuxianq 4f8afe4cc6
feat: [nvbugs/5261055][nvbugs/5170160] non-invasive pipeline parallelism (#4034)
Signed-off-by: Yuxian Qiu <142763828+yuxianq@users.noreply.github.com>
2025-05-16 04:16:53 +08:00
..
__init__.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
eagle3.py [fix] Fix flashinfer + speculation issues (#3686) 2025-04-28 14:34:22 -04:00
interface.py [fix] Pad requests to maximum draft length in spec decode (#3957) 2025-04-30 11:02:18 -04:00
mtp.py feat: [nvbugs/5261055][nvbugs/5170160] non-invasive pipeline parallelism (#4034) 2025-05-16 04:16:53 +08:00
utils.py feat: add relaxed acceptance for DS (#3865) 2025-05-01 21:50:36 +08:00