| .. |
|
utils
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
allocateKvCache.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
assignReqSeqSlots.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
cacheFormatter.cpp
|
fix cache buffer (#3942)
|
2025-05-07 09:49:44 +08:00 |
|
cacheFormatter.h
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
cacheTransBuffer.cpp
|
fix cache buffer (#3942)
|
2025-05-07 09:49:44 +08:00 |
|
cacheTransBuffer.h
|
fix cache buffer (#3942)
|
2025-05-07 09:49:44 +08:00 |
|
cacheTransceiver.cpp
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
capacityScheduler.cpp
|
feat: allocate minimal blocks per window size (#3028)
|
2025-04-17 16:04:57 +08:00 |
|
CMakeLists.txt
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
contextProgress.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
createNewDecoderRequests.cpp
|
fix: 5197419 and removed unused runtime kernels (#3631)
|
2025-04-23 18:04:50 +02:00 |
|
dataTransceiver.cpp
|
chore: disable some env for disagg defaultly (#3415)
|
2025-04-14 10:08:10 +08:00 |
|
dataTransceiver.h
|
feat: Add BW measurement (#3070)
|
2025-03-28 10:53:00 +08:00 |
|
dataTransceiverImpl.cpp
|
feat: allocate minimal blocks per window size (#3028)
|
2025-04-17 16:04:57 +08:00 |
|
dataTransceiverImpl.h
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
decoderBuffers.cpp
|
refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893)
|
2025-05-04 13:24:29 +02:00 |
|
encoderBuffers.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
encoderBuffers.h
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
evictionPolicy.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
generateRequestOptions.cpp
|
refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893)
|
2025-05-04 13:24:29 +02:00 |
|
guidedDecoder.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
handleContextLogits.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
handleGenerationLogits.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
kvCacheEventManager.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
kvCacheManager.cpp
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
kvCacheTransferManager.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
llmRequest.cpp
|
refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893)
|
2025-05-04 13:24:29 +02:00 |
|
logitsPostProcessor.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
loraBuffers.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
loraBuffers.h
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
makeDecodingBatchInputOutput.cpp
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
medusaBuffers.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
microBatchScheduler.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
mlaCacheFormatter.cpp
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
mlaCacheFormatter.h
|
cacheTransceiver buffer manager (#3798)
|
2025-04-27 11:48:15 +08:00 |
|
pauseRequests.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
peftCacheManager.cpp
|
feat: Support PeftCacheManager in Torch (#3186)
|
2025-04-04 12:38:08 +08:00 |
|
promptTuningBuffers.cpp
|
feat: Offloading Multimodal embedding table to CPU in Chunked Prefill Mode (#3380)
|
2025-04-21 14:31:01 +08:00 |
|
rnnStateBuffers.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
rnnStateBuffers.h
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
rnnStateManager.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
runtimeBuffers.cpp
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
sequenceSlotManager.cpp
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
transformerBuffers.cpp
|
Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338)
|
2025-04-08 23:51:27 +08:00 |
|
trtEncoderModel.cpp
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
trtEncoderModel.h
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
trtGptModel.h
|
[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)
|
2025-05-06 15:06:46 +02:00 |
|
trtGptModelFactory.h
|
Update TensorRT-LLM (#2873)
|
2025-03-11 21:13:42 +08:00 |
|
trtGptModelInflightBatching.cpp
|
fix: Properly get decoding mode according to same logic as cpp. (#4026)
|
2025-05-06 21:53:17 +08:00 |
|
trtGptModelInflightBatching.h
|
fix: request termination in pipeline parallelism (#3892)
|
2025-05-05 21:51:41 +08:00 |
|
trtGptModelV1.cpp
|
feat: Offloading Multimodal embedding table to CPU in Chunked Prefill Mode (#3380)
|
2025-04-21 14:31:01 +08:00 |
|
trtGptModelV1.h
|
fix: request termination in pipeline parallelism (#3892)
|
2025-05-05 21:51:41 +08:00 |
|
updateDecoderBuffers.cpp
|
fix: Fix C++ decoder synchronization in PyTorch (#3106)
|
2025-04-23 23:55:27 +08:00 |
