..
utils
[TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path ( #6348 )
2025-09-27 19:29:30 -04:00
allocateKvCache.cpp
[ https://nvbugs/5627710 ][fix] Fix synchronization bugs in KvCacheTransferManager that can cause corrupted blocks ( #9056 )
2025-12-02 09:10:21 -06:00
assignReqSeqSlots.cpp
[ https://nvbugs/5394392 ][fix] Enlarge scheduler capacity under disagg bs == 1 ( #6537 )
2025-08-15 09:52:06 -07:00
cacheFormatter.cpp
[TRTLLM-9465][fix] Swap TP-CP grouping order ( #10350 )
2026-01-05 20:08:03 +08:00
cacheFormatter.h
[TRTLLM-8540][feat] Add support for disagg in DSv3.2 ( #8735 )
2025-11-12 08:21:11 -08:00
cacheTransBuffer.cpp
[None][fix] enhance warning in cacheTransBuffer ( #9390 )
2025-11-24 02:17:54 -08:00
cacheTransBuffer.h
[TRTLLM-8540][feat] Add support for disagg in DSv3.2 ( #8735 )
2025-11-12 08:21:11 -08:00
cacheTransceiver.cpp
[None][chore] Async Transfer Manager ( #9891 )
2026-01-20 12:12:47 -05:00
capacityScheduler.cpp
[ https://nvbugs/5677746 ][fix] Use first PP rank's schedule result in other PP ranks to fix PP hang ( #9659 )
2025-12-08 18:43:52 -08:00
CMakeLists.txt
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 ( #10736 )
2026-01-24 04:48:39 -05:00
contextProgress.cpp
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
createNewDecoderRequests.cpp
[None] [refactor] Minor cleanup and improvements ( #7619 )
2025-10-03 11:40:06 +02:00
dataTransceiver.cpp
[ https://nvbugs/5702786 ][fix] Fix race conditions in KV cache communication during unexpected termination ( #10076 )
2025-12-23 14:09:51 +02:00
dataTransceiver.h
[None][feat] add detailed KV cache transfer time breakdown ( #8521 )
2025-10-29 10:11:09 +08:00
decoderBuffers.cpp
refactor: Enhanced handling of decoder requests and logits within the batch manager ( #6055 )
2025-07-18 12:12:08 +02:00
encoderBuffers.cpp
Feat: Variable-Beam-Width-Search (VBWS) part4 ( #3979 )
2025-05-12 22:32:29 +02:00
encoderBuffers.h
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
evictionPolicy.cpp
[TLLM-6777][feature] Support SWA KV cache reuse OOW block detach ( #7922 )
2025-10-13 09:18:12 -07:00
guidedDecoder.cpp
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
handleContextLogits.cpp
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
handleGenerationLogits.cpp
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
kvCacheEventManager.cpp
[TRTLLM-9601][feat] Expose mmKeys for multimodal to integrate with dynamo. ( #9604 )
2025-12-15 08:42:30 +08:00
kvCacheManager.cpp
[ https://nvbugs/5740377 ][fix] Lock resource to fix potential access to released data ( #10827 )
2026-01-21 14:17:29 +08:00
kvCacheManagerV2Utils.cpp
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 ( #10736 )
2026-01-24 04:48:39 -05:00
kvCacheManagerV2Utils.cu
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 ( #10736 )
2026-01-24 04:48:39 -05:00
kvCacheManagerV2Utils.h
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 ( #10736 )
2026-01-24 04:48:39 -05:00
kvCacheTransferManager.cpp
[None][feat] update trtllm-gen nvfp4 kernels with better performance ( #9510 )
2025-12-03 21:35:49 +08:00
llmRequest.cpp
[TRTLLM-8831][feat] Enable early exit with overlap scheduler ( #8587 )
2025-11-17 18:07:13 +01:00
logitsPostProcessor.cpp
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
loraBuffers.cpp
fix: [nvbugs/5287097] Align PP layer distribution between pytorch and TRT flow. ( #4399 )
2025-05-19 14:25:36 -07:00
loraBuffers.h
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
makeDecodingBatchInputOutput.cpp
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
medusaBuffers.cpp
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
microBatchScheduler.cpp
[nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608 ) ( #4621 )
2025-05-26 17:10:55 +08:00
mlaCacheFormatter.cpp
[TRTLLM-9465][fix] Swap TP-CP grouping order ( #10350 )
2026-01-05 20:08:03 +08:00
mlaCacheFormatter.h
[TRTLLM-8540][feat] Add support for disagg in DSv3.2 ( #8735 )
2025-11-12 08:21:11 -08:00
pauseRequests.cpp
[TRTLLM-909][feat] Overlap context chunks in pipeline parallel mode ( #9308 )
2025-11-25 22:11:51 +01:00
peftCacheManager.cpp
[ https://nvbugs/5322131 ][feat] Multi-LoRA serving with CUDA Graph ( #8279 )
2026-01-22 14:01:18 +01:00
promptTuningBuffers.cpp
perf: Removing initializing ptuning buffers to zero ( #4915 )
2025-06-09 21:57:21 -04:00
rnnStateBuffers.cpp
[TRTLLM-5171] chore: Remove GptSession/V1 from TRT workflow ( #4092 )
2025-05-14 23:10:04 +02:00
rnnStateBuffers.h
Update TensorRT-LLM ( #2873 )
2025-03-11 21:13:42 +08:00
rnnStateManager.cpp
fix: [nvbugs/5287097] Align PP layer distribution between pytorch and TRT flow. ( #4399 )
2025-05-19 14:25:36 -07:00
runtimeBuffers.cpp
Revert "feat: nanobind bindings ( #5961 )" ( #6160 )
2025-07-18 10:12:54 +08:00
scheduledBlocksManager.h
refactor: Scheduling based on KV cache state ( #4865 )
2025-06-16 08:14:58 +02:00
sequenceSlotManager.cpp
refactor: Remove enforced sorted order of batch slots ( #3502 )
2025-07-14 17:23:02 +02:00
transformerBuffers.cpp
refactor: remove batch_manager::KvCacheConfig and use executor::KvCacheConfig instead ( #5384 )
2025-06-26 19:45:52 +08:00
trtEncoderModel.cpp
refactor: remove TrtGptModelOptionalParams ( #5165 )
2025-06-20 10:31:40 +02:00
trtEncoderModel.h
refactor: remove TrtGptModelOptionalParams ( #5165 )
2025-06-20 10:31:40 +02:00
trtGptModel.h
refactor: remove TrtGptModelOptionalParams ( #5165 )
2025-06-20 10:31:40 +02:00
trtGptModelFactory.h
refactor: remove TrtGptModelOptionalParams ( #5165 )
2025-06-20 10:31:40 +02:00
trtGptModelInflightBatching.cpp
[None][chore] Async Transfer Manager ( #9891 )
2026-01-20 12:12:47 -05:00
trtGptModelInflightBatching.h
[None][refactor] decoding inputs, part 2 ( #5799 )
2025-11-18 14:38:51 +01:00
updateDecoderBuffers.cpp
refactor: Speculative decoding buffers part 2 ( #5316 )
2025-06-27 17:41:48 +02:00
6f07fa81d7