TensorRT-LLMs/cpp/tensorrt_llm/runtime
石晓伟 59f41c067d
Update TensorRT-LLM (#708)
* Update TensorRT-LLM

* update

* Bump version to 0.7.0
2023-12-20 16:38:28 +08:00
..
utils Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
bufferManager.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
bufferView.h Initial commit 2023-09-20 00:29:41 -07:00
CMakeLists.txt Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
decodingOutput.cpp Initial commit 2023-09-20 00:29:41 -07:00
gptDecoder.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
gptSession.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
iBuffer.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ipcUtils.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
iTensor.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
memoryCounters.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ncclCommunicator.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
ncclCommunicator.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
promptTuningParams.cpp Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
runtimeBuffers.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
runtimeKernels.cu Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
runtimeKernels.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
tensorView.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tllmBuffers.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
tllmLogger.cpp Initial commit 2023-09-20 00:29:41 -07:00
tllmRuntime.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
tllmRuntime.h Update code 2023-09-28 09:00:05 -07:00
torch.h Initial commit 2023-09-20 00:29:41 -07:00
torchUtils.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
torchView.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
worldConfig.cpp Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00