TensorRT-LLMs/tensorrt_llm/_torch/speculative
Mike Iovine 41a6c98544
Support CUDA graphs for EAGLE3 (#3176)
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
2025-04-17 04:53:50 +08:00
..
__init__.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
eagle3.py Support CUDA graphs for EAGLE3 (#3176) 2025-04-17 04:53:50 +08:00
interface.py refactor: collect executor and decoder states into dataclass (#3234) 2025-04-15 16:31:45 +08:00
mtp.py refactor: collect executor and decoder states into dataclass (#3234) 2025-04-15 16:31:45 +08:00
utils.py Support CUDA graphs for EAGLE3 (#3176) 2025-04-17 04:53:50 +08:00