TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

Kaiyu Xie 250d9c293d Update TensorRT-LLM Release branch (#1445 ) * Update TensorRT-LLM --------- Co-authored-by: Bhuvanesh Sridharan <bhuvan.sridharan@gmail.com> Co-authored-by: Morgan Funtowicz <funtowiczmo@gmail.com> Co-authored-by: Eddie-Wang1120 <wangjinheng1120@163.com> Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>		2024-04-12 17:59:19 +08:00
..
contextFusedMultiHeadAttention	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
cutlass_kernels	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decoderMaskedMultiheadAttention	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
mixtureOfExperts	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
onlineSoftmaxBeamsearchKernels	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
parallelDecoding	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
unfusedAttentionKernels	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
weightOnlyBatchedGemv	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
banBadWords.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
banBadWords.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
banRepeatNgram.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
banRepeatNgram.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
beamSearchTopkKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
beamSearchTopkKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
CMakeLists.txt	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
customAllReduceKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
customAllReduceKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decoderMaskedMultiheadAttention.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decoderMaskedMultiheadAttention.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decoderMaskedMultiheadAttentionUtils.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decodingCommon.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decodingCommon.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decodingKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
decodingKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
gptKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
gptKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
groupGemm.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
groupGemm.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
kvCacheUtils.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
layernormKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
layernormKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
lookupKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
lookupKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
mambaConv1dKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
mambaConv1dKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
multiHeadAttentionCommon.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
onlineSoftmaxBeamsearchKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
onlineSoftmaxBeamsearchKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
penaltyKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
penaltyKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
penaltyTypes.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
preQuantScaleKernel.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
preQuantScaleKernel.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
quantization.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
quantization.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
rmsnormKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
rmsnormKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingAirTopPKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingAirTopPKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingTopKKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingTopKKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingTopPKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
samplingTopPKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
selectiveScan.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
selectiveScan.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
splitkGroupGemm.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
splitkGroupGemm.h	Update TensorRT-LLM Release branch (#1192 )	2024-02-29 17:20:55 +08:00
stopCriteriaKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
stopCriteriaKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
unfusedAttentionKernels.cu	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00
unfusedAttentionKernels.h	Update TensorRT-LLM Release branch (#1445 )	2024-04-12 17:59:19 +08:00