Kaiyu Xie deaae40bd7 Update TensorRT-LLM (#787) ... * Update TensorRT-LLM --------- Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>		2024-01-02 17:54:32 +08:00
..
utils	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
bufferManager.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
bufferView.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
CMakeLists.txt	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
decodingOutput.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
gptDecoder.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
gptDecoderBatch.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
gptJsonConfig.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
gptSession.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
iBuffer.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
ipcUtils.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
iTensor.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
memoryCounters.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
ncclCommunicator.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
ncclCommunicator.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
promptTuningParams.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
runtimeBuffers.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
runtimeBuffers.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
runtimeKernels.cu	Update TensorRT-LLM main branch (#754)	2023-12-27 17:41:24 +08:00
runtimeKernels.h	Update TensorRT-LLM main branch (#754)	2023-12-27 17:41:24 +08:00
statefulGptDecoder.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
statefulGptDecoder.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tensorView.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tllmBuffers.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tllmLogger.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tllmRuntime.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
tllmRuntime.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
torch.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
torchUtils.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
torchView.h	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00
worldConfig.cpp	Update TensorRT-LLM (#787)	2024-01-02 17:54:32 +08:00