TensorRT-LLMs/tensorrt_llm/_torch/custom_ops
Zongfei Jing a0f523c628 refactor(moe): improve FC1/FC2 get_valid_tactics and tuning config
- Refactor get_valid_tactics for FC1 and FC2 runners to define
  mma_tiler_mn_candidates and cluster_shape_mn_candidates together
- Use itertools.product for cleaner iteration pattern
- Update get_tuning_config for FC1 and FC2 to use DynamicTensorSpec
  and ConstraintSpec for proper dynamic tensor handling
- FC1: Add constraint for input scale factor shape inference
- FC2: Add constraints for input scale factor and alpha_scale shape

Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>
2026-01-12 22:13:46 -08:00
..
__init__.py [None][feat] Support Qwen3 next (#7892) 2025-09-29 21:16:07 +08:00
cpp_custom_ops.py [TRTLLM-8821][feat] Apply AutoTuner to AllReduce Op for strategy tuning. (#8531) 2026-01-05 15:44:37 +08:00
cute_dsl_custom_ops.py refactor(moe): improve FC1/FC2 get_valid_tactics and tuning config 2026-01-12 22:13:46 -08:00
flashinfer_custom_ops.py [TRTC-1943][feat] Env vars override support in LLM API (#9104) 2025-12-01 10:04:49 -08:00
torch_custom_ops.py [TRTLLM-8821][feat] Apply AutoTuner to AllReduce Op for strategy tuning. (#8531) 2026-01-05 15:44:37 +08:00
trtllm_gen_custom_ops.py [None][perf] TRTLLM MoE maps to lower tuning buckets when ep>1 (#9998) 2026-01-05 17:16:12 +01:00
userbuffers_custom_ops.py feat: Introduce UB allocator for pytorch flow (#3257) 2025-04-08 18:39:49 +08:00