TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-13 22:18:36 +08:00

History

Kaiyu Xie 4bb65f216f Update TensorRT-LLM (#1274 ) * Update TensorRT-LLM --------- Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com> Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>		2024-03-12 18:15:52 +08:00
..
contextFusedMultiHeadAttention	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
cutlass_kernels	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttention	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
mixtureOfExperts	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
onlineSoftmaxBeamsearchKernels	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
parallelDecoding	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
unfusedAttentionKernels	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
weightOnlyBatchedGemv	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
banBadWords.cu	Update TensorRT-LLM (#1098 )	2024-02-18 15:48:08 +08:00
banBadWords.h	Update TensorRT-LLM (#1098 )	2024-02-18 15:48:08 +08:00
banRepeatNgram.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
banRepeatNgram.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
beamSearchTopkKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
beamSearchTopkKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
CMakeLists.txt	Update TensorRT-LLM (#1168 )	2024-02-27 17:37:34 +08:00
customAllReduceKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
customAllReduceKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttention.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttention.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decoderMaskedMultiheadAttentionUtils.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingCommon.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingCommon.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
decodingKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
gptKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
gptKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
groupGemm.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
groupGemm.h	Update TensorRT-LLM (20240116) (#891 )	2024-01-16 20:03:11 +08:00
kvCacheUtils.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
layernormKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
layernormKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
lookupKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
lookupKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
multiHeadAttentionCommon.h	Update TensorRT-LLM (#524 )	2023-12-01 22:27:51 +08:00
onlineSoftmaxBeamsearchKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
onlineSoftmaxBeamsearchKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
penaltyKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
penaltyKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
penaltyTypes.h	Update TensorRT-LLM (#1098 )	2024-02-18 15:48:08 +08:00
preQuantScaleKernel.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
preQuantScaleKernel.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
quantization.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
quantization.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
rmsnormKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
rmsnormKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingAirTopPKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingAirTopPKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingTopKKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingTopKKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingTopPKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
samplingTopPKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
selectiveScan.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
selectiveScan.h	Update TensorRT-LLM (#1233 )	2024-03-05 18:32:53 +08:00
splitkGroupGemm.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
splitkGroupGemm.h	Update TensorRT-LLM (20240116) (#891 )	2024-01-16 20:03:11 +08:00
stopCriteriaKernels.cu	Update TensorRT-LLM (#1098 )	2024-02-18 15:48:08 +08:00
stopCriteriaKernels.h	Update TensorRT-LLM (#1098 )	2024-02-18 15:48:08 +08:00
unfusedAttentionKernels.cu	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00
unfusedAttentionKernels.h	Update TensorRT-LLM (#1274 )	2024-03-12 18:15:52 +08:00