TensorRT-LLMs/tensorrt_llm/_torch/attention_backend
Mike Iovine 41a6c98544
Support CUDA graphs for EAGLE3 (#3176)
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
2025-04-17 04:53:50 +08:00
..
__init__.py Update (#2978) 2025-03-23 16:39:35 +08:00
flashinfer.py chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00
interface.py Support CUDA graphs for EAGLE3 (#3176) 2025-04-17 04:53:50 +08:00
star_flashinfer.py chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00
trtllm.py chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00
utils.py chore: Refine attention backend interface. (#3271) 2025-04-09 02:34:53 +08:00
vanilla.py chore: Mass integration of release/0.18 (#3421) 2025-04-16 10:03:29 +08:00