kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-28 14:44:24 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
b0d287c9b7
TensorRT-LLMs/tensorrt_llm/_torch/attention_backend
History
Tian Zheng 9832787050
[feat] Enable NVFP4 output for TRTLLM attention kernels (#4737) 
Signed-off-by: Tian Zheng <29906817+Tom-Zheng@users.noreply.github.com>
2025-06-03 10:00:17 +08:00
..
__init__.py feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (#3438) 2025-05-02 13:25:30 +08:00
flashinfer.py [https://nvbugs/5123103][fix] Fix torch compile for DeepSeekV3 (#3952) 2025-05-19 22:12:25 +08:00
interface.py [feat] Enable NVFP4 output for TRTLLM attention kernels (#4737) 2025-06-03 10:00:17 +08:00
star_flashinfer.py Remove dummy forward path (#3669) 2025-04-18 16:17:50 +08:00
trtllm.py [feat] Enable NVFP4 output for TRTLLM attention kernels (#4737) 2025-06-03 10:00:17 +08:00
utils.py [feat] Integrate Hopper chunked attention kernels (#4330) 2025-05-22 17:10:57 -04:00
vanilla.py Remove dummy forward path (#3669) 2025-04-18 16:17:50 +08:00