TensorRT-LLMs/cpp/tensorrt_llm/runtime
Kaiyu Xie 6755a3f077
Update TensorRT-LLM (#422)
* Update TensorRT-LLM

---------

Co-authored-by: Tltin <TltinDeng01@gmail.com>
Co-authored-by: zhaohb <zhaohbcloud@126.com>
Co-authored-by: Bradley Heilbrun <brad@repl.it>
Co-authored-by: nqbao11 <nqbao11.01@gmail.com>
Co-authored-by: Nikhil Varghese <nikhil@bot-it.ai>
2023-11-18 00:05:54 +08:00
..
utils Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
bufferManager.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
bufferView.h Initial commit 2023-09-20 00:29:41 -07:00
CMakeLists.txt Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
decodingOutput.cpp Initial commit 2023-09-20 00:29:41 -07:00
gptDecoder.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
gptSession.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
iBuffer.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
ipcUtils.cpp Kaiyu/update main (#5) 2023-10-18 22:38:53 +08:00
iTensor.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
memoryCounters.cpp Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
ncclCommunicator.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
ncclCommunicator.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
promptTuningParams.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
runtimeBuffers.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
runtimeKernels.cu Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
runtimeKernels.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
tensorView.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmBuffers.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmLogger.cpp Initial commit 2023-09-20 00:29:41 -07:00
tllmRuntime.cpp Update TensorRT-LLM (#148) 2023-10-27 12:10:00 +08:00
tllmRuntime.h Update code 2023-09-28 09:00:05 -07:00
torch.h Initial commit 2023-09-20 00:29:41 -07:00
torchUtils.h Initial commit 2023-09-20 00:29:41 -07:00
torchView.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
worldConfig.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00