TensorRT-LLMs/cpp/tensorrt_llm/thop
QI JUN f8b4077654
[nvbugs/5326453] Avoid nesting NCCL grouping in allgather OP (#5789)
Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
2025-07-08 15:39:27 +09:00
..
allgatherOp.cpp [nvbugs/5326453] Avoid nesting NCCL grouping in allgather OP (#5789) 2025-07-08 15:39:27 +09:00
allreduceOp.cpp Feat/ds r1 min latency opt round3, add router gemm, fused a gemm, PDL (#4560) 2025-06-14 17:36:22 +08:00
attentionOp.cpp [feat] Piecewise cuda graph support for MLA (#4467) 2025-06-17 18:58:38 +08:00
causalConv1dOp.cpp fix: fix license bug (#5200) 2025-06-13 18:58:15 +08:00
CMakeLists.txt Feat/ds r1 min latency opt round3, add router gemm, fused a gemm, PDL (#4560) 2025-06-14 17:36:22 +08:00
convertSpecDecodingMaskToPackedMaskOp.cpp
cublasScaledMM.cpp [fix] Remove stale cublas heuristics (#4326) 2025-05-14 17:35:51 -07:00
cublasScaledMM.h Feat/ds r1 min latency opt round3, add router gemm, fused a gemm, PDL (#4560) 2025-06-14 17:36:22 +08:00
cutlassScaledMM.cpp refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00
dsv3FusedAGemmOp.cpp Feat/ds r1 min latency opt round3, add router gemm, fused a gemm, PDL (#4560) 2025-06-14 17:36:22 +08:00
dsv3RouterGemmOp.cpp Feat/ds r1 min latency opt round3, add router gemm, fused a gemm, PDL (#4560) 2025-06-14 17:36:22 +08:00
dynamicDecodeOp.cpp
dynamicDecodeOp.h
fmhaPackMaskOp.cpp
fp4BatchedQuantize.cpp
fp4BlockScaleMoe.cpp [nvbugs/5336321][fix] Enable attention dp = False test case, Fix TRTLLM Gen Moe workspace allocation (#5463) 2025-07-04 23:23:41 +09:00
fp4Gemm.cpp feat: Add w4a8_mxfp4_fp8 quantization recipe. (#4867) 2025-06-16 11:30:57 +08:00
fp4GemmTrtllmGen.cpp feat: update DeepSeek FP8 TRT-LLM Gen cubins (#4643) 2025-06-03 14:07:54 -07:00
fp4Op.cpp
fp4Quantize.cpp feat: Fallback to NCCL for various patterns when input size is large. (#4080) 2025-05-08 11:13:13 -07:00
fp4Quantize.h feat: Fallback to NCCL for various patterns when input size is large. (#4080) 2025-05-08 11:13:13 -07:00
fp8BatchedGemmTrtllmGen.cpp [TRTLLM-5589] feat: Minor optimizations for tunable FP8 batched GEMM op. (#5139) 2025-06-18 14:33:46 +08:00
fp8BlockScaleMoe.cpp [TRTLLM-6100] fix: Nvbug 5356427: autotuned TRTLLM Gen fp8 block scale MoE illegal memory access (#5676) 2025-07-04 10:38:08 +08:00
fp8BlockScalingGemm.cpp feat: update DeepSeek FP8 TRT-LLM Gen cubins (#4643) 2025-06-03 14:07:54 -07:00
fp8Op.cpp feat: Fallback to NCCL for various patterns when input size is large. (#4080) 2025-05-08 11:13:13 -07:00
fp8Op.h feat: Fallback to NCCL for various patterns when input size is large. (#4080) 2025-05-08 11:13:13 -07:00
fp8PerTensorScaleMoe.cpp [TRTLLM-5770] feat: Integrate TRT-LLM Gen FP8 block scale MoE with Pytorch workflow kernel autotuner (#5207) 2025-06-17 21:01:56 +08:00
fp8PerTensorScalingTrtllmGenGemm.cpp feat: update DeepSeek FP8 TRT-LLM Gen cubins (#4643) 2025-06-03 14:07:54 -07:00
fp8Quantize.cpp
fusedQKNormRopeOp.cpp perf: Add fused q_norm/k_norm/RoPE for Qwen3. (#4482) 2025-05-23 15:31:04 +08:00
fusedTopkSoftmax.cpp refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00
gatherTreeOp.cpp [TRTLLM-5171] chore: Remove GptSession/V1 from TRT workflow (#4092) 2025-05-14 23:10:04 +02:00
groupRmsNormOp.cpp feat: Add heuristic for GroupRMSNorm kernel selection. (#4047) 2025-05-13 08:52:53 +08:00
llama4MinLatency.cpp Cherry pick feat/llama4 to main (#4739) 2025-05-30 05:28:40 +08:00
logitsBitmaskOp.cpp
loraOp.cpp
mambaConv1dOp.cpp
mlaPreprocessOp.cpp [feat] Optimize KV Cache Reuse for MLA (#4869) 2025-06-13 11:03:05 +08:00
moeCommOp.cpp
moeLoadBalanceOp.cpp feat: large-scale EP(part 6: Online EP load balancer integration for GB200 nvfp4) (#4818) 2025-06-08 10:25:18 +08:00
moeOp.cpp [TRTLLM-5330] perf: Optimize MoE supplementary kernels for large-scale EP (#5215) 2025-06-17 15:23:24 +08:00
mtpOp.cpp [https://nvbugs/5123103][fix] Fix torch compile for DeepSeekV3 (#3952) 2025-05-19 22:12:25 +08:00
ncclCommunicatorOp.cpp feat: [nvbugs/5261055][nvbugs/5170160] non-invasive pipeline parallelism (#4034) 2025-05-16 04:16:53 +08:00
ncclCommunicatorOp.h feat: [nvbugs/5261055][nvbugs/5170160] non-invasive pipeline parallelism (#4034) 2025-05-16 04:16:53 +08:00
noAuxTcOp.cpp
parallelDecodeKVCacheUpdateOp.cpp
redrafterCurandOp.cpp [TRTLLM-5171] chore: Remove GptSession/V1 from TRT workflow (#4092) 2025-05-14 23:10:04 +02:00
reducescatterOp.cpp feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
relativeAttentionBiasOp.cpp
renormMoeRoutingOp.cpp Add customized renormalized moe routing kernel for moe cutlass backend (#4955) 2025-06-09 17:38:50 +08:00
selectiveScanOp.cpp
thUtils.cpp
thUtils.h chore: Refine printed info of CHECK_TYPE. (#5295) 2025-06-18 15:35:41 +08:00
userbuffersFinalizeOp.cpp
userbuffersTensor.cpp
userbuffersTensor.h
weightOnlyQuantOp.cpp