kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-01 08:41:13 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
7c73c2ff4b
TensorRT-LLMs/tensorrt_llm/_torch/speculative
History
YueWeng 9a4f60687f
[https://nvbugs/5480289][fix] release slot manager in mtp MTPHiddenStatesManager (#7340) 
Signed-off-by: Yue Weng <25103990+yweng0828@users.noreply.github.com>
2025-09-02 19:37:51 -07:00
..
__init__.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
auto_heuristic.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
drafter.py [None][feat] Optimize CUDA graph memory usage for spec decode cases (#6718) 2025-08-08 13:56:53 -04:00
drafting_loops.py [TRTLLM-7353][feat] Implement capturable drafting loops for speculation (#7100) 2025-09-01 14:37:44 -04:00
eagle3.py [None][feat] Deepseek: Start Eagle work (#6210) 2025-08-22 12:57:17 -04:00
interface.py [None][feat] Deepseek: Start Eagle work (#6210) 2025-08-22 12:57:17 -04:00
model_drafter.py [TRTLLM-7353][feat] Implement capturable drafting loops for speculation (#7100) 2025-09-01 14:37:44 -04:00
mtp.py [https://nvbugs/5480289][fix] release slot manager in mtp MTPHiddenStatesManager (#7340) 2025-09-02 19:37:51 -07:00
ngram.py [None][refactor] Move draft token padding out of Drafter (#7134) 2025-08-27 11:07:50 +02:00
utils.py [None][feat] Deepseek: Start Eagle work (#6210) 2025-08-22 12:57:17 -04:00