TensorRT-LLMs/tests/unittest/_torch/thop
chenfeiz0326 7f5716ef83
Cherry-pick trtllm-gen from feat/llama4 to main (#4086)
* feat: TRT-LLM Gen FP8 MoE Llama4

Signed-off-by: Nikita Korobov <nkorobov@nvidia.com>

* feat: TRT-LLM Gen llama4 MoE Top1 routing

Signed-off-by: Jiqun Tu <jtu@nvidia.com>

* feat: add per tensor FP8 TRT-LLM Gen GEMMs

Signed-off-by: Nikita Korobov <nkorobov@nvidia.com>

* Update

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

* Update

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

* Add license for cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/gemmCubins

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

* Add guard for routingIndicesClusterKernel

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

* Guard sm90+ for routingkernels

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

* Guard sm90+ for routingkernels

Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>

---------

Signed-off-by: Nikita Korobov <nkorobov@nvidia.com>
Signed-off-by: Jiqun Tu <jtu@nvidia.com>
Signed-off-by: Chenfei Zhang <chenfeiz@nvidia.com>
Co-authored-by: Nikita Korobov <nkorobov@nvidia.com>
Co-authored-by: Jiqun Tu <jtu@nvidia.com>
2025-05-08 14:13:01 -07:00
..
deep_gemm_tests.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_cublas_mm.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_fp4_bmm_quantize.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp4_gemm_quantize.py TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770) 2025-04-29 11:19:11 -04:00
test_fp4_linear.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_batched_gemm.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_block_scale_gemm.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_linear.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_quantize.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_logits_bitmask_op.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_mamba_conv1d_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_moe_alltoall.py feat: Add MNNVL MoE A2A support (#3504) 2025-04-25 17:29:08 +08:00
test_moe.py Cherry-pick trtllm-gen from feat/llama4 to main (#4086) 2025-05-08 14:13:01 -07:00
test_noaux_tc.py Clean up modeling_deepseek.py (#3640) 2025-04-18 17:54:33 -07:00
test_scaled_mm.py test: fix cublas_scaled_mm with aligned workspace size (#3600) 2025-04-21 14:51:42 +08:00
test_selective_scan_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00