TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

Kaiyu Xie 5955b8afba Update TensorRT-LLM Release branch (#1192 ) * Update TensorRT-LLM --------- Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>		2024-02-29 17:20:55 +08:00
..
contextFusedMultiHeadAttention	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
cutlass_kernels	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decoderMaskedMultiheadAttention	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
mixtureOfExperts	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
onlineSoftmaxBeamsearchKernels	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
parallelDecoding	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
unfusedAttentionKernels	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
weightOnlyBatchedGemv	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
banBadWords.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
banBadWords.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
banRepeatNgram.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
banRepeatNgram.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
beamSearchTopkKernels.cu	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
beamSearchTopkKernels.h	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
CMakeLists.txt	Update TensorRT-LLM (#506 )	2023-11-30 16:46:22 +08:00
customAllReduceKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
customAllReduceKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decoderMaskedMultiheadAttention.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decoderMaskedMultiheadAttention.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decoderMaskedMultiheadAttentionUtils.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decodingCommon.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decodingCommon.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decodingKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
decodingKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
gptKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
gptKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
groupGemm.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
groupGemm.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
kvCacheUtils.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
layernormKernels.cu	Update TensorRT-LLM (#506 )	2023-11-30 16:46:22 +08:00
layernormKernels.h	Initial commit	2023-09-20 00:29:41 -07:00
lookupKernels.cu	Initial commit	2023-09-20 00:29:41 -07:00
lookupKernels.h	Initial commit	2023-09-20 00:29:41 -07:00
multiHeadAttentionCommon.h	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
onlineSoftmaxBeamsearchKernels.cu	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
onlineSoftmaxBeamsearchKernels.h	Update TensorRT-LLM (#708 )	2023-12-20 16:38:28 +08:00
penaltyKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
penaltyKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
penaltyTypes.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
preQuantScaleKernel.cu	Update TensorRT-LLM (#506 )	2023-11-30 16:46:22 +08:00
preQuantScaleKernel.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
quantization.cu	Update code	2023-09-28 09:00:05 -07:00
quantization.h	Initial commit	2023-09-20 00:29:41 -07:00
rmsnormKernels.cu	Update TensorRT-LLM (#506 )	2023-11-30 16:46:22 +08:00
rmsnormKernels.h	Initial commit	2023-09-20 00:29:41 -07:00
samplingAirTopPKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
samplingTopKKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
samplingTopKKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
samplingTopPKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
samplingTopPKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
selectiveScan.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
selectiveScan.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
selectiveScanCommon.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
splitkGroupGemm.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
splitkGroupGemm.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
stopCriteriaKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
stopCriteriaKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
unfusedAttentionKernels.cu	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
unfusedAttentionKernels.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00