kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-16 07:53:55 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
cce9556858
TensorRT-LLMs/tensorrt_llm/_torch/speculative
History
kris1025 cce9556858
[https://nvbugs/5485886][fix] Fix resource free of Eagle3ResourceManager (#7437) 
Signed-off-by: linquanh <linquanh@nvidia.com>
2025-09-04 17:38:13 +08:00
..
__init__.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
auto_heuristic.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
drafter.py [None][feat] Optimize CUDA graph memory usage for spec decode cases (#6718) 2025-08-08 13:56:53 -04:00
drafting_loops.py [TRTLLM-7353][feat] Implement capturable drafting loops for speculation (#7100) 2025-09-01 14:37:44 -04:00
eagle3.py [https://nvbugs/5485886][fix] Fix resource free of Eagle3ResourceManager (#7437) 2025-09-04 17:38:13 +08:00
interface.py [TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948) 2025-09-03 15:16:11 -07:00
model_drafter.py [TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948) 2025-09-03 15:16:11 -07:00
mtp.py [TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948) 2025-09-03 15:16:11 -07:00
ngram.py [None][refactor] Move draft token padding out of Drafter (#7134) 2025-08-27 11:07:50 +02:00
utils.py [None][feat] Deepseek: Start Eagle work (#6210) 2025-08-22 12:57:17 -04:00