kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-21 18:25:20 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
44cfd757b2
TensorRT-LLMs/tests/unittest/_torch/thop
History
Ruoqian Guo db7446fda7
Feat: add deep_gemm swapab Kernel (#4430) 
* feat: add deepgemm_swapab

feat: add fp8_gemm_kernel_swapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

feat: set threshold for deepgemm and deepgemmswapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* docs: update README.md

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* fix: std::runtime_error needs #include <stdexcept>

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* chores: remove the redundant code

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* feat: support for dense deep_gemm swapab

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

* chores: remove redundant code

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>

---------

Signed-off-by: Ruoqian Guo <ruoqiang@nvidia.com>
Co-authored-by: Tao Li @ NVIDIA <tali@nvidia.com>
2025-05-21 10:48:43 +08:00
..
deep_gemm_tests.py Feat: add deep_gemm swapab Kernel (#4430) 2025-05-21 10:48:43 +08:00
test_cublas_mm.py [fix] Remove stale cublas heuristics (#4326) 2025-05-14 17:35:51 -07:00
test_fp4_bmm_quantize.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp4_gemm_quantize.py TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770) 2025-04-29 11:19:11 -04:00
test_fp4_linear.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_block_scale_gemm.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_linear.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_fp8_quantize.py chore: reorganize some unit tests of PyTorch (#3780) 2025-04-23 11:19:10 -07:00
test_logits_bitmask_op.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_mamba_conv1d_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_moe_alltoall.py feat: Add MNNVL MoE A2A support (#3504) 2025-04-25 17:29:08 +08:00
test_moe.py feat: TRT-LLM Gen integration for BMM and MoE refactoring (#4280) 2025-05-16 13:31:53 +02:00
test_noaux_tc.py Clean up modeling_deepseek.py (#3640) 2025-04-18 17:54:33 -07:00
test_scaled_mm.py test: fix cublas_scaled_mm with aligned workspace size (#3600) 2025-04-21 14:51:42 +08:00
test_selective_scan_op.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
test_tllmg_bmm.py feat: TRT-LLM Gen integration for BMM and MoE refactoring (#4280) 2025-05-16 13:31:53 +02:00