kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
9bd15f1937
TensorRT-LLMs/cpp/tensorrt_llm/runtime
History
Kaiyu Xie 9bd15f1937
TensorRT-LLM v0.10 update 
* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <lokravi@amazon.com>
Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>
2024-06-05 20:43:25 +08:00
..
utils TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
bufferManager.cpp Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
bufferView.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
CMakeLists.txt TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
decodingOutput.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
generationConfig.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
generationConfig.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
gptDecoder.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
gptDecoderBatch.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
gptJsonConfig.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
gptSession.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
iBuffer.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
ipcUtils.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
iTensor.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
layerProfiler.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
layerProfiler.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraCache.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraManager.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraManager.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraModule.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraUtils.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
loraUtils.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
medusaModule.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
medusaModule.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
memoryCounters.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
ncclCommunicator.cpp Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
ncclCommunicator.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
promptTuningParams.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
rnnStateBuffers.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
rnnStateBuffers.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
runtimeBuffers.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
runtimeBuffers.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
runtimeKernels.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
runtimeKernels.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
statefulGptDecoder.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
statefulGptDecoder.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
tensorView.h Update TensorRT-LLM Release branch (#1192) 2024-02-29 17:20:55 +08:00
tllmBuffers.cpp Update TensorRT-LLM Release branch (#1192) 2024-02-29 17:20:55 +08:00
tllmBuffers.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
tllmLogger.cpp Update TensorRT-LLM Release branch (#1192) 2024-02-29 17:20:55 +08:00
tllmRuntime.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
tllmRuntime.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
torch.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
torchUtils.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
torchView.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
transformerBuffers.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
transformerBuffers.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
workerPool.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
worldConfig.cpp TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00