TensorRT-LLMs/cpp/tensorrt_llm/runtime
Kaiyu Xie 587d063e6d
Update TensorRT-LLM (#506)
* Update TensorRT-LLM

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2023-11-30 16:46:22 +08:00
..
utils Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
bufferManager.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
bufferView.h Initial commit 2023-09-20 00:29:41 -07:00
CMakeLists.txt Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
decodingOutput.cpp Initial commit 2023-09-20 00:29:41 -07:00
gptDecoder.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
gptSession.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
iBuffer.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ipcUtils.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
iTensor.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
memoryCounters.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ncclCommunicator.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ncclCommunicator.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
promptTuningParams.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
runtimeBuffers.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
runtimeKernels.cu Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
runtimeKernels.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tensorView.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tllmBuffers.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tllmLogger.cpp Initial commit 2023-09-20 00:29:41 -07:00
tllmRuntime.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tllmRuntime.h Update code 2023-09-28 09:00:05 -07:00
torch.h Initial commit 2023-09-20 00:29:41 -07:00
torchUtils.h Initial commit 2023-09-20 00:29:41 -07:00
torchView.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
worldConfig.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00