TensorRT-LLMs/cpp/tensorrt_llm/kernels
2024-04-16 19:40:08 +08:00
..
beamSearchKernels Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
contextFusedMultiHeadAttention Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
cutlass_kernels Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttention Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
mixtureOfExperts Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
parallelDecoding Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
unfusedAttentionKernels Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
weightOnlyBatchedGemv Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
banBadWords.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
banBadWords.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
banRepeatNgram.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
banRepeatNgram.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
beamSearchKernels.cu Update TensorRT-LLM (#1427) 2024-04-09 17:03:34 +08:00
beamSearchKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
CMakeLists.txt Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
customAllReduceKernels.cu Update TensorRT-LLM (#1427) 2024-04-09 17:03:34 +08:00
customAllReduceKernels.h Update TensorRT-LLM (#1427) 2024-04-09 17:03:34 +08:00
decoderMaskedMultiheadAttention.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttention.h Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
decoderMaskedMultiheadAttentionUtils.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
decodingCommon.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
decodingCommon.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
decodingKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
decodingKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
gptKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
gptKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
groupGemm.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
groupGemm.h Update TensorRT-LLM (20240116) (#891) 2024-01-16 20:03:11 +08:00
kvCacheUtils.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
layernormKernels.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
layernormKernels.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
lookupKernels.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
lookupKernels.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
mambaConv1dKernels.cu Update TensorRT-LLM (#1427) 2024-04-09 17:03:34 +08:00
mambaConv1dKernels.h Update TensorRT-LLM (#1427) 2024-04-09 17:03:34 +08:00
multiHeadAttentionCommon.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
penaltyKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
penaltyKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
penaltyTypes.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
preQuantScaleKernel.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
preQuantScaleKernel.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
quantization.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
quantization.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
rmsnormKernels.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
rmsnormKernels.h Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
samplingAirTopPKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
samplingTopKKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
samplingTopKKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
samplingTopPKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
samplingTopPKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
selectiveScan.cu Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
selectiveScan.h Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
splitkGroupGemm.cu Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
splitkGroupGemm.h Update TensorRT-LLM (20240116) (#891) 2024-01-16 20:03:11 +08:00
stopCriteriaKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
stopCriteriaKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
unfusedAttentionKernels.cu Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00
unfusedAttentionKernels.h Update TensorRT-LLM (#1455) 2024-04-16 19:40:08 +08:00