kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
3ff4f503ad
TensorRT-LLMs/cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe
History
ChristinaZ 7e033c392e
Feat: Add vectorized loading for finalize kernel in MoE Trtllm backend (#5919) 
Signed-off-by: Christina Zhang <83400082+ChristinaZ@users.noreply.github.com>
2025-07-17 12:38:29 +08:00
..
CMakeLists.txt feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) 2025-04-21 10:01:33 +08:00
DevKernel.cu Feat: Add vectorized loading for finalize kernel in MoE Trtllm backend (#5919) 2025-07-17 12:38:29 +08:00
DevKernel.h Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
IntFastDiv.h [fix] Fix comment to pass guardwords check (#5191) 2025-06-13 15:49:59 +08:00
RoutingDeepSeek.cu Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
RoutingKernel.cuh fix: fast redux detection in trtllm gen routing kernel (#5941) 2025-07-13 16:35:07 +08:00
RoutingKernel.h Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
RoutingKernelTopK.cuh fix: fast redux detection in trtllm gen routing kernel (#5941) 2025-07-13 16:35:07 +08:00
RoutingLlama4.cu Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
RoutingRenormalize.cu Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
runner.cu Refactor the rest routing part for the routing kernels in the MoE TRT-LLM backend (#5771) 2025-07-11 16:37:56 +08:00
runner.h [feat] Add TRTLLM MoE nvfp4 cubins for mid-high concurrency; attention_dp for TRTLLM MoE (#5723) 2025-07-10 14:06:50 +08:00