hlu1 31624b079a feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) ... * Add TRT-LLM Gen MOE to Deepseek fix fused moe rebase bug. Fix atol in test_fp4_gemm_quantize.py fix fused moe rebase bug. Fix FusedMoe. Disable 2nd routing kernel preexit Bump routing reduction to fp32 Disable PDL for fc1 [DEBUG] Lift token limit to 16k [Bugfix] Token limit to 16k + fp32 routing + tanh Make fp8 tileN 8 Fix FP8 MoE + Remove redundent temp output for FP4 [FP8-only] Avoid wasting CTAs for activation kernel fix: unblock FP8 weightloading with trtllm-gen Remove max_token limit for trtllm-gen path perf: avoid type-conversion and fill_ from aten Minor fix Signed-off-by: Hao Lu <haolu@nvidia.com> * Fix rebase issues Signed-off-by: Hao Lu <haolu@nvidia.com> * Fix compile issue Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> * CI clean Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> --------- Signed-off-by: Hao Lu <haolu@nvidia.com> Signed-off-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com> Co-authored-by: Zongfei Jing <20381269+zongfeijing@users.noreply.github.com>		2025-04-21 10:01:33 +08:00
..
utils	feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387)	2025-04-21 10:01:33 +08:00
__init__.py	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
functional.py	feat: Add FP8 support for SM 120 (#3248)	2025-04-14 16:05:41 -07:00
image_processing.py	Update TensorRT-LLM (#2582)	2024-12-16 21:50:47 -08:00
layers.py	fix: Add missing parameter for WeightOnlyQuantRowLinear module (#2768)	2025-03-31 16:20:30 +08:00
mode.py	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
quantize_by_modelopt.py	feat: adding multimodal (only image for now) support in trtllm-bench (#3490)	2025-04-18 07:06:16 +08:00
quantize.py	fix:update the default excluded_modules value for fp8rowwise recipe. (#3477)	2025-04-12 16:00:21 +08:00