Kaiyu Xie f430a4b447 Update TensorRT-LLM (#1688) ... * Update TensorRT-LLM --------- Co-authored-by: IbrahimAmin <ibrahimamin532@gmail.com> Co-authored-by: Fabian Joswig <fjosw@users.noreply.github.com> Co-authored-by: Pzzzzz <hello-cd.plus@hotmail.com> Co-authored-by: CoderHam <hemant@cohere.com> Co-authored-by: Konstantin Lopuhin <kostia.lopuhin@gmail.com>		2024-05-28 20:07:49 +08:00
..
utils	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
bufferManager.cpp	Update TensorRT-LLM (#1427)	2024-04-09 17:03:34 +08:00
bufferView.h	Update TensorRT-LLM (#1168)	2024-02-27 17:37:34 +08:00
CMakeLists.txt	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
decodingOutput.cpp	Update TensorRT-LLM (#1639)	2024-05-21 17:51:02 +08:00
generationConfig.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
generationConfig.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
gptDecoder.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
gptDecoderBatch.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
gptJsonConfig.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
gptSession.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
iBuffer.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
ipcUtils.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
iTensor.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
layerProfiler.cpp	Update TensorRT-LLM (#1554)	2024-05-07 23:34:28 +08:00
layerProfiler.h	Update TensorRT-LLM (#1554)	2024-05-07 23:34:28 +08:00
lookaheadModule.h	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
loraCache.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
loraManager.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
loraManager.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
loraModule.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
loraUtils.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
loraUtils.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
medusaModule.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
medusaModule.h	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
memoryCounters.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
ncclCommunicator.cpp	Update TensorRT-LLM (#1233)	2024-03-05 18:32:53 +08:00
ncclCommunicator.h	Update TensorRT-LLM (#1274)	2024-03-12 18:15:52 +08:00
promptTuningParams.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
rnnStateBuffers.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
rnnStateBuffers.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
runtimeBuffers.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
runtimeBuffers.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
runtimeKernels.cu	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
runtimeKernels.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
speculativeDecodingModule.h	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
statefulGptDecoder.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
statefulGptDecoder.h	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
tensorView.h	Update TensorRT-LLM (#846)	2024-01-09 21:03:35 +08:00
tllmBuffers.cpp	Update TensorRT-LLM (#1233)	2024-03-05 18:32:53 +08:00
tllmBuffers.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
tllmLogger.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tllmRuntime.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00
tllmRuntime.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
torch.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
torchUtils.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
torchView.h	Update TensorRT-LLM (#1168)	2024-02-27 17:37:34 +08:00
transformerBuffers.cpp	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
transformerBuffers.h	Update TensorRT-LLM (#1598)	2024-05-14 16:43:41 +08:00
workerPool.h	Update TensorRT-LLM (#1554)	2024-05-07 23:34:28 +08:00
worldConfig.cpp	Update TensorRT-LLM (#1688)	2024-05-28 20:07:49 +08:00