TensorRT-LLMs/tensorrt_llm/_torch/speculative
wili 56cdfe5c6c
[TRTLLM-5000][feat] NGrams V2 (#4569)
Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
2025-06-27 23:00:17 +08:00
..
__init__.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
draft_target.py Speculation: Draft Target in new FW (#4558) 2025-06-17 02:26:08 +08:00
drafter.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
eagle3.py Revert "feature: unify new_tokens format sample state to trtllm samper new_tokens format (#4401)" (#5474) 2025-06-25 20:56:04 -07:00
interface.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
mtp.py Revert "feature: unify new_tokens format sample state to trtllm samper new_tokens format (#4401)" (#5474) 2025-06-25 20:56:04 -07:00
ngram.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
utils.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00