TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

Kaiyu Xie f430a4b447 Update TensorRT-LLM (#1688 ) * Update TensorRT-LLM --------- Co-authored-by: IbrahimAmin <ibrahimamin532@gmail.com> Co-authored-by: Fabian Joswig <fjosw@users.noreply.github.com> Co-authored-by: Pzzzzz <hello-cd.plus@hotmail.com> Co-authored-by: CoderHam <hemant@cohere.com> Co-authored-by: Konstantin Lopuhin <kostia.lopuhin@gmail.com>		2024-05-28 20:07:49 +08:00
..
beamSearchKernels	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
contextFusedMultiHeadAttention	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
cutlass_kernels	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
decoderMaskedMultiheadAttention	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
mixtureOfExperts	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
parallelDecoding	Update TensorRT-LLM (#1492 )	2024-04-24 14:44:22 +08:00
unfusedAttentionKernels	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
weightOnlyBatchedGemv	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
banBadWords.cu	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
banBadWords.h	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
banRepeatNgram.cu	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
banRepeatNgram.h	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
beamSearchKernels.cu	Update TensorRT-LLM (#1492 )	2024-04-24 14:44:22 +08:00
beamSearchKernels.h	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
CMakeLists.txt	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
convertSpecDecodingMaskToPackedMask.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
convertSpecDecodingMaskToPackedMask.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
cumsumLastDim.cu	Update TensorRT-LLM (#1554 )	2024-05-07 23:34:28 +08:00
cumsumLastDim.h	Update TensorRT-LLM (#1554 )	2024-05-07 23:34:28 +08:00
customAllReduceKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
customAllReduceKernels.h	Update TensorRT-LLM (#1427 )	2024-04-09 17:03:34 +08:00
decoderMaskedMultiheadAttention.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
decoderMaskedMultiheadAttention.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
decoderMaskedMultiheadAttentionUtils.h	Update TensorRT-LLM (#1554 )	2024-05-07 23:34:28 +08:00
decodingCommon.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingCommon.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingKernels.cu	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
decodingKernels.h	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
gptKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
gptKernels.h	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
groupGemm.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
groupGemm.h	Update TensorRT-LLM (20240116) (#891 )	2024-01-16 20:03:11 +08:00
kvCacheIndex.h	Update TensorRT-LLM (#1492 )	2024-04-24 14:44:22 +08:00
kvCacheUtils.h	Update TensorRT-LLM (#1492 )	2024-04-24 14:44:22 +08:00
layernormKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
layernormKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
lookupKernels.cu	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
lookupKernels.h	Update TensorRT-LLM (#1639 )	2024-05-21 17:51:02 +08:00
lruKernel.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
lruKernel.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
mambaConv1dKernels.cu	Update TensorRT-LLM (#1427 )	2024-04-09 17:03:34 +08:00
mambaConv1dKernels.h	Update TensorRT-LLM (#1492 )	2024-04-24 14:44:22 +08:00
multiHeadAttentionCommon.h	Update TensorRT-LLM (#1455 )	2024-04-16 19:40:08 +08:00
penaltyKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
penaltyKernels.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
penaltyTypes.h	Update TensorRT-LLM (#1554 )	2024-05-07 23:34:28 +08:00
preQuantScaleKernel.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
preQuantScaleKernel.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
quantization.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
quantization.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
rmsnormKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
rmsnormKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingAirTopPKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
samplingTopKKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
samplingTopKKernels.h	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
samplingTopPKernels.cu	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
samplingTopPKernels.h	Update TensorRT-LLM (#1598 )	2024-05-14 16:43:41 +08:00
selectiveScan.cu	Update TensorRT-LLM (#1554 )	2024-05-07 23:34:28 +08:00
selectiveScan.h	Update TensorRT-LLM (#1358 )	2024-03-26 20:47:14 +08:00
splitkGroupGemm.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
splitkGroupGemm.h	Update TensorRT-LLM (20240116) (#891 )	2024-01-16 20:03:11 +08:00
stopCriteriaKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
stopCriteriaKernels.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
unfusedAttentionKernels.cu	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00
unfusedAttentionKernels.h	Update TensorRT-LLM (#1688 )	2024-05-28 20:07:49 +08:00