TensorRT-LLMs/cpp/tensorrt_llm/runtime
Kaiyu Xie b2fd493c16
Update TensorRT-LLM (#349)
* Update TensorRT-LLM

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2023-11-10 22:30:31 +08:00
..
utils Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
bufferManager.cpp Update 2023-10-10 23:22:17 -07:00
bufferView.h Initial commit 2023-09-20 00:29:41 -07:00
CMakeLists.txt Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
decodingOutput.cpp Initial commit 2023-09-20 00:29:41 -07:00
gptDecoder.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
gptSession.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
iBuffer.cpp Kaiyu/update main (#5) 2023-10-18 22:38:53 +08:00
ipcUtils.cpp Kaiyu/update main (#5) 2023-10-18 22:38:53 +08:00
iTensor.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
memoryCounters.cpp Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
ncclCommunicator.cpp Update 2023-10-10 23:22:17 -07:00
ncclCommunicator.h Update 2023-10-10 23:22:17 -07:00
promptTuningParams.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
runtimeBuffers.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
runtimeKernels.cu Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
runtimeKernels.h Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tensorView.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmBuffers.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmLogger.cpp Initial commit 2023-09-20 00:29:41 -07:00
tllmRuntime.cpp Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
tllmRuntime.h Update code 2023-09-28 09:00:05 -07:00
torch.h Initial commit 2023-09-20 00:29:41 -07:00
torchUtils.h Initial commit 2023-09-20 00:29:41 -07:00
torchView.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
worldConfig.cpp Update 2023-10-10 23:22:17 -07:00