TensorRT-LLMs/cpp/tensorrt_llm/runtime
Kaiyu Xie 728cc0044b
Update TensorRT-LLM (#1233)
* Update TensorRT-LLM

---------

Co-authored-by: Morgan Funtowicz <funtowiczmo@gmail.com>
Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2024-03-05 18:32:53 +08:00
..
utils Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
bufferManager.cpp Update TensorRT-LLM (#1122) 2024-02-21 21:30:55 +08:00
bufferView.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
CMakeLists.txt Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
decodingOutput.cpp Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
gptDecoder.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
gptDecoderBatch.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
gptJsonConfig.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
gptSession.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
iBuffer.cpp Update TensorRT-LLM (#1122) 2024-02-21 21:30:55 +08:00
ipcUtils.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
iTensor.cpp Update TensorRT-LLM (#1122) 2024-02-21 21:30:55 +08:00
loraManager.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
loraManager.h Update TensorRT-LLM (#846) 2024-01-09 21:03:35 +08:00
loraModule.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
loraModule.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
loraUtils.cpp Update TensorRT-LLM (#846) 2024-01-09 21:03:35 +08:00
loraUtils.h Update TensorRT-LLM (#846) 2024-01-09 21:03:35 +08:00
medusaModule.cpp Update TensorRT-LLM (#1098) 2024-02-18 15:48:08 +08:00
medusaModule.h Update TensorRT-LLM (#1098) 2024-02-18 15:48:08 +08:00
memoryCounters.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
ncclCommunicator.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
ncclCommunicator.h Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
promptTuningParams.cpp Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
runtimeBuffers.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
runtimeBuffers.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
runtimeKernels.cu Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
runtimeKernels.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
statefulGptDecoder.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
statefulGptDecoder.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
tensorView.h Update TensorRT-LLM (#846) 2024-01-09 21:03:35 +08:00
tllmBuffers.cpp Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
tllmBuffers.h Update TensorRT-LLM (#1233) 2024-03-05 18:32:53 +08:00
tllmLogger.cpp Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
tllmRuntime.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
tllmRuntime.h Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
torch.h Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
torchUtils.h Update TensorRT-LLM (#787) 2024-01-02 17:54:32 +08:00
torchView.h Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
worldConfig.cpp Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00