TensorRT-LLMs/tensorrt_llm/_torch/speculative
Enwei Zhu 1b9781e8e7
[TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine) (#6300)
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-08-07 05:53:48 -04:00
..
__init__.py [refactor] Simplification of Speculative decoding configs - Part 2 (#5936) 2025-07-23 09:20:27 +08:00
drafter.py [TRTLLM-6392][feat] Support turning on/off spec decoding dynamically (#6363) 2025-07-31 15:31:39 -04:00
eagle3.py [None] [feat] Add model gpt-oss (#6645) 2025-08-07 03:04:18 -04:00
interface.py [None] [feat] Add model gpt-oss (#6645) 2025-08-07 03:04:18 -04:00
model_drafter.py [TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine) (#6300) 2025-08-07 05:53:48 -04:00
mtp.py [https://nvbugs/5252313][fix] Fix torch compile + MTP (#6554) 2025-08-05 10:31:29 -04:00
ngram.py [TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine) (#6300) 2025-08-07 05:53:48 -04:00
utils.py [TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine) (#6300) 2025-08-07 05:53:48 -04:00