TensorRT-LLMs/cpp/tensorrt_llm/kernels/trtllmGenKernels
zhhuang-nv 94e6167879
optimize cudaMemGetInfo for TllmGenFmhaRunner (#3907)
Signed-off-by: Zhen Huang <145532724+zhhuang-nv@users.noreply.github.com>
2025-04-29 14:17:07 +08:00
..
batchedGemm feat: Adding FP8 BMM from Codegen (#3541) 2025-04-16 10:37:15 +02:00
blockscaleGemm feat: trtllm-gen fp4 GEMM for pytorch workflow (#3423) 2025-04-11 02:28:07 +08:00
blockScaleMoe doc: Update doc for Deepseek min latency (#3717) 2025-04-22 23:07:59 +08:00
fmha optimize cudaMemGetInfo for TllmGenFmhaRunner (#3907) 2025-04-29 14:17:07 +08:00
gemm feat: trtllm-gen fp4 GEMM for pytorch workflow (#3423) 2025-04-11 02:28:07 +08:00
CMakeLists.txt feat: [Deepseek] Add trtllm-gen MOE FP4 MOE backend (#3387) 2025-04-21 10:01:33 +08:00