TensorRT-LLMs/tensorrt_llm/_torch/speculative
ameynaik-hub 1e5e71aa42
Mtp optimizations round1 (#5689)
Signed-off-by: Amey Naik <212485788+ameynaik-hub@users.noreply.github.com>
Co-authored-by: Kefeng-Duan <176893526+Kefeng-Duan@users.noreply.github.com>
2025-07-25 13:48:27 -04:00
..
__init__.py [refactor] Simplification of Speculative decoding configs - Part 2 (#5936) 2025-07-23 09:20:27 +08:00
drafter.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00
eagle3.py [https://nvbugs/5355316] fix: update torch.compile option to fix triton store_cubin error (#5865) 2025-07-14 17:17:30 +08:00
interface.py [fix] Correct the returned value of has_spec_drafter (#6178) 2025-07-21 11:38:59 -04:00
model_drafter.py [TRTLLM-6453][feat] Support chunked prefill on spec decode 2 model (#6104) 2025-07-24 21:50:11 -04:00
mtp.py Mtp optimizations round1 (#5689) 2025-07-25 13:48:27 -04:00
ngram.py [TRTLLM-6352][feat] Migrate EAGLE3 and draft/target speculation to Drafter (#6007) 2025-07-17 21:15:01 +08:00
utils.py Mtp optimizations round1 (#5689) 2025-07-25 13:48:27 -04:00