TensorRT-LLMs/tensorrt_llm/_torch/speculative
Jinyang Yuan 1128dc2a5a
perf: Use pinned H2D to reduce bubbles (#3147)
Signed-off-by: Jinyang Yuan <154768711+jinyangyuan-nvidia@users.noreply.github.com>
2025-04-04 22:23:10 +08:00
..
__init__.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
eagle3.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
interface.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
mtp.py perf: Use pinned H2D to reduce bubbles (#3147) 2025-04-04 22:23:10 +08:00
utils.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00