TensorRT-LLMs/cpp/tensorrt_llm/kernels
2024-07-24 19:50:28 +08:00
..
beamSearchKernels Update TensorRT-LLM (#1891) 2024-07-04 14:37:19 +08:00
chunkScan Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
contextFusedMultiHeadAttention Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
cutlass_kernels Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
decoderMaskedMultiheadAttention Update TensorRT-LLM (#2016) 2024-07-24 19:50:28 +08:00
mixtureOfExperts Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
speculativeDecoding Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
unfusedAttentionKernels Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
weightOnlyBatchedGemv Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
banBadWords.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
banBadWords.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
banRepeatNgram.cu Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
banRepeatNgram.h Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
beamSearchKernels.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
beamSearchKernels.h Update TensorRT-LLM (#1891) 2024-07-04 14:37:19 +08:00
buildRelativeAttentionBiasKernel.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
buildRelativeAttentionBiasKernel.h Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
CMakeLists.txt Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
cumsumLastDim.cu Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
cumsumLastDim.h Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
customAllReduceKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
customAllReduceKernels.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
decoderMaskedMultiheadAttention.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
decoderMaskedMultiheadAttention.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
decoderMaskedMultiheadAttentionUtils.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
decodingCommon.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
decodingCommon.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
decodingKernels.cu Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
decodingKernels.h Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
gptKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
gptKernels.h Update TensorRT-LLM (#2016) 2024-07-24 19:50:28 +08:00
groupGemm.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
groupGemm.h Update TensorRT-LLM (20240116) (#891) 2024-01-16 20:03:11 +08:00
kvCacheUtils.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
layernormKernels.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
layernormKernels.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
lookupKernels.cu Update TensorRT-LLM (#1639) 2024-05-21 17:51:02 +08:00
lookupKernels.h Update TensorRT-LLM (#1639) 2024-05-21 17:51:02 +08:00
lruKernel.cu Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
lruKernel.h Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
mambaConv1dKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
mambaConv1dKernels.h Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
multiHeadAttentionCommon.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
penaltyKernels.cu Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
penaltyKernels.h Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
penaltyTypes.h Update TensorRT-LLM (#1554) 2024-05-07 23:34:28 +08:00
preQuantScaleKernel.cu open source 3706e7395b9b58994412617992727c8ff2d14c9f (#2010) 2024-07-24 05:48:06 +08:00
preQuantScaleKernel.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
quantization.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
quantization.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
rmsnormKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
rmsnormKernels.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
samplingAirTopPKernels.cu Update TensorRT-LLM (#1891) 2024-07-04 14:37:19 +08:00
samplingTopKKernels.cu Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00
samplingTopKKernels.h Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
samplingTopPKernels.cu Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
samplingTopPKernels.h Update TensorRT-LLM (#1598) 2024-05-14 16:43:41 +08:00
selectiveScan.cu Update TensorRT-LLM (#1954) 2024-07-16 15:30:25 +08:00
selectiveScan.h Update TensorRT-LLM (#1918) 2024-07-09 14:42:22 +08:00
splitkGroupGemm.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
splitkGroupGemm.h Update TensorRT-LLM (20240116) (#891) 2024-01-16 20:03:11 +08:00
stopCriteriaKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
stopCriteriaKernels.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
unfusedAttentionKernels.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
unfusedAttentionKernels.h Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00