TensorRT-LLMs/tensorrt_llm/_torch/custom_ops
Jinyang Yuan b618e1f55b
perf: Eliminate the need for attention DP padding when possible (#3439)
Signed-off-by: Jinyang Yuan <154768711+jinyangyuan-nvidia@users.noreply.github.com>
Co-authored-by: raccoonliukai <raccoonliu@tencent.com>
2025-05-17 13:30:55 +08:00
..
__init__.py feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (#3438) 2025-05-02 13:25:30 +08:00
cpp_custom_ops.py perf: Eliminate the need for attention DP padding when possible (#3439) 2025-05-17 13:30:55 +08:00
flashinfer_custom_ops.py feat: Add group_rms_norm kernel to normalize multiple inputs in a single operator. (#3438) 2025-05-02 13:25:30 +08:00
torch_custom_ops.py chore: Mass Integration 0.19 (#4255) 2025-05-16 10:53:25 +02:00
userbuffers_custom_ops.py feat: Introduce UB allocator for pytorch flow (#3257) 2025-04-08 18:39:49 +08:00