TensorRT-LLMs/cpp/tensorrt_llm/runtime
Kaiyu Xie a75618df24
Update TensorRT-LLM (#667)
* Update TensorRT-LLM

---------

Co-authored-by: 0xymoro <jerrymeng100@gmail.com>
Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2023-12-15 22:14:51 +08:00
..
utils Update TensorRT-LLM (#524) 2023-12-01 22:27:51 +08:00
bufferManager.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
bufferView.h Initial commit 2023-09-20 00:29:41 -07:00
CMakeLists.txt Update TensorRT-LLM (#667) 2023-12-15 22:14:51 +08:00
decodingOutput.cpp Initial commit 2023-09-20 00:29:41 -07:00
gptDecoder.cpp Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#667) 2023-12-15 22:14:51 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#667) 2023-12-15 22:14:51 +08:00
gptSession.cpp Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
iBuffer.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
ipcUtils.cpp Kaiyu/update main (#5) 2023-10-18 22:38:53 +08:00
iTensor.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
memoryCounters.cpp Update TensorRT-LLM (#302) 2023-11-07 19:51:58 +08:00
ncclCommunicator.cpp Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
ncclCommunicator.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
promptTuningParams.cpp Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
runtimeBuffers.h Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
runtimeKernels.cu Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
runtimeKernels.h Update TensorRT-LLM (#422) 2023-11-18 00:05:54 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
tensorView.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmBuffers.h Update TensorRT-LLM (#349) 2023-11-10 22:30:31 +08:00
tllmLogger.cpp Initial commit 2023-09-20 00:29:41 -07:00
tllmRuntime.cpp Update TensorRT-LLM (#524) 2023-12-01 22:27:51 +08:00
tllmRuntime.h Update code 2023-09-28 09:00:05 -07:00
torch.h Initial commit 2023-09-20 00:29:41 -07:00
torchUtils.h Update TensorRT-LLM (#465) 2023-11-24 22:12:26 +08:00
torchView.h Update TensorRT-LLM (#613) 2023-12-08 17:49:24 +08:00
worldConfig.cpp Update TensorRT-LLM (#667) 2023-12-15 22:14:51 +08:00