kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-27 14:13:34 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
30a19fcf7c
TensorRT-LLMs/tensorrt_llm/_torch/speculative
History
Robin Kobus 30a19fcf7c
[TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 
Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-07-07 16:30:43 +02:00
..
__init__.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00
draft_target.py Speculation: Draft Target in new FW (#4558) 2025-06-17 02:26:08 +08:00
drafter.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00
eagle3.py MTP and derivatives: Align sample state with trtllm sampler sample state (#5675) 2025-07-03 19:55:48 +02:00
interface.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00
mtp.py MTP and derivatives: Align sample state with trtllm sampler sample state (#5675) 2025-07-03 19:55:48 +02:00
ngram.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00
user_provided.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00
utils.py [TRTLLM-6291] feat: Add user-provided speculative decoding support (#5204) 2025-07-07 16:30:43 +02:00