kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-25 13:12:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
1fca654bfd
TensorRT-LLMs/tests/unittest/trt/functional
History
Yukun He 0ae7017342
Unify two versions of AllReduce custom op (#3032) 
* Rewrite unit test for unified allreduce op. Removing the legacy unit test.
* Revise formats, fusion_op bindings. Put all tensors as optional inputs.
* Move the MoeAllreduceOp to a separate custom op.
* Move all the fusion patterns to the new version of the AllReduce fusion kernel. Remove the AllReduce strategy config. Revise the AllReduce strategies and fusion pattern definitions.
* Add more TODOs, fixing minor bugs, and remove legacy code.

Signed-off-by: Yukun He <23156053+hyukn@users.noreply.github.com>
2025-04-22 21:58:42 +08:00
..
__init__.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_alibi.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_allreduce_norm.py Unify two versions of AllReduce custom op (#3032) 2025-04-22 21:58:42 +08:00
test_allreduce_prepost_residual_norm.py Unify two versions of AllReduce custom op (#3032) 2025-04-22 21:58:42 +08:00
test_arange.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_argmax.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_assertion.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_avg_pool2d.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_cast.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_conv2d.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_conv3d.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_cos.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_cumsum.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_dora.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_einsum.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_embedding_single_gpu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_exp.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_expand.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_flatten.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_flip.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fp4_gemm_ootb.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fp4_gemm.py feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) 2025-04-21 10:01:33 +08:00
test_gather_nd.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_gather.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_geglu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_gelu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_gemm_swiglu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_group_norm.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_identity.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_index_select.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_interpolate.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_logsoftmax.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_lora.py chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
test_low_latency_gemm.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_mamba_conv1d.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_masked_scatter.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_masked_select.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_matmul.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_meshgrid2d.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_moe.py feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) 2025-04-21 10:01:33 +08:00
test_nccl.py Unify two versions of AllReduce custom op (#3032) 2025-04-22 21:58:42 +08:00
test_nonzero.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_outer.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_pad.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_permute.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_pp_reduce_scatter.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_quant.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_rearrange.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_repeat_interleave.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_repeat.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_rg_lru.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_sample.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_scatter_nd.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_scatter.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_select.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_selective_scan.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_sigmoid.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_silu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_sin.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_slice.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_softplus.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_split.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_squeeze.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_swiglu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_topk.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_transpose.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_unbind.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_unsqueeze.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_view.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_where.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00