TensorRT-LLMs/tensorrt_llm/_torch/speculative
Ziyi Xiong 7bc2d9e993
[https://nvbugs/5537878][fix] Reserve an extra slot for padded batch (#7998)
Signed-off-by: ziyixiong-nv <219238287+ziyixiong-nv@users.noreply.github.com>
2025-10-03 08:42:52 -07:00
..
__init__.py [None][feat] Draft: Save state first pass (#7012) 2025-10-01 18:40:55 -04:00
auto_heuristic.py [None][feat] Clean up ngram auto mode, add max_concurrency to configs (#6676) 2025-08-07 12:51:47 -04:00
drafter.py [None][feat] Draft: Save state first pass (#7012) 2025-10-01 18:40:55 -04:00
drafting_loops.py [TRTLLM-7330][feat] Eagle3 cuda graph support for the first draft model inference (#7363) 2025-09-26 11:28:05 +08:00
eagle3.py [https://nvbugs/5537878][fix] Reserve an extra slot for padded batch (#7998) 2025-10-03 08:42:52 -07:00
interface.py [None][feat] Draft: Save state first pass (#7012) 2025-10-01 18:40:55 -04:00
model_drafter.py [TRTLLM-8271][fix] Fix CDL overlap scheduling performance (#7971) 2025-09-26 16:05:10 -04:00
mtp.py [TRTLLM-6393][feat] add static tree sampling and verification (#7161) 2025-09-26 13:16:16 -04:00
ngram.py [TRTLLM-6668][feat] Enable overlap scheduler for two-model spec decoding (#7651) 2025-09-16 07:33:44 +08:00
save_hidden_state.py [None][feat] Draft: Save state first pass (#7012) 2025-10-01 18:40:55 -04:00
spec_tree_manager.py [TRTLLM-6393][feat] add static tree sampling and verification (#7161) 2025-09-26 13:16:16 -04:00
utils.py [None][feat] Draft: Save state first pass (#7012) 2025-10-01 18:40:55 -04:00