kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-07 03:31:58 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
4cd8543d8c
TensorRT-LLMs/tensorrt_llm/_torch/speculative
History
liji-nv c345f5876c
[feat] Support torch compile for attention dp (#5086) 
Signed-off-by: Jin Li <59594262+liji-nv@users.noreply.github.com>
2025-07-01 13:48:52 -04:00
..
__init__.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
draft_target.py Speculation: Draft Target in new FW (#4558) 2025-06-17 02:26:08 +08:00
drafter.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
eagle3.py Reintroduce with perf fixes: feature: unify new_tokens format sample state to trtllm samper tokens format (#5513) 2025-06-30 11:58:59 -07:00
interface.py [feat] Support torch compile for attention dp (#5086) 2025-07-01 13:48:52 -04:00
mtp.py [feat] Support torch compile for attention dp (#5086) 2025-07-01 13:48:52 -04:00
ngram.py [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
utils.py Reintroduce with perf fixes: feature: unify new_tokens format sample state to trtllm samper tokens format (#5513) 2025-06-30 11:58:59 -07:00