TensorRT-LLMs/tensorrt_llm/_torch/modules
yuxianq b9b1c1368c
feat: Support unfused rope in MLA. (#3610)
Signed-off-by: Yuxian Qiu <142763828+yuxianq@users.noreply.github.com>
2025-04-17 16:50:49 +08:00
..
mamba feat: Nemotron-H model support (#3430) 2025-04-16 14:05:56 -07:00
__init__.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
attention.py feat: Support unfused rope in MLA. (#3610) 2025-04-17 16:50:49 +08:00
decoder_layer.py chore: Use ellipsis as default value to detect whether residual argument is provided (#3626) 2025-04-17 12:31:58 +08:00
embedding.py refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370) 2025-04-11 15:34:20 -07:00
fused_moe.py Clean up linear.py, mlp.py, gated_mlp.py (#3553) 2025-04-16 12:21:44 -07:00
gated_mlp.py Clean up linear.py, mlp.py, gated_mlp.py (#3553) 2025-04-16 12:21:44 -07:00
linear.py Clean up linear.py, mlp.py, gated_mlp.py (#3553) 2025-04-16 12:21:44 -07:00
logits_procesor.py Update (#2978) 2025-03-23 16:39:35 +08:00
mlp.py Clean up linear.py, mlp.py, gated_mlp.py (#3553) 2025-04-16 12:21:44 -07:00
multi_stream_utils.py [Deepseek] Redesign multi-stream API (#3459) 2025-04-11 23:00:25 -07:00
rms_norm.py chore: Use ellipsis as default value to detect whether residual argument is provided (#3626) 2025-04-17 12:31:58 +08:00
rotary_embedding.py feat: Support cos_sin_cache in all cases. (#3517) 2025-04-16 13:48:44 +08:00