TensorRT-LLMs/cpp/include/tensorrt_llm/batch_manager
Thor Johnsen 0998a7bf20
[https://nvbugs/5721661][fix] Prevent out-of-bounds read (#9879)
Signed-off-by: thorjohnsen <41591019+thorjohnsen@users.noreply.github.com>
2026-01-15 10:51:40 -06:00
..
allocateKvCache.h
assignReqSeqSlots.h
cacheTransceiver.h [TRTLLM-8540][feat] Add support for disagg in DSv3.2 (#8735) 2025-11-12 08:21:11 -08:00
capacityScheduler.h
common.h
contextProgress.h
createNewDecoderRequests.h [None] [refactor] Minor cleanup and improvements (#7619) 2025-10-03 11:40:06 +02:00
decoderBuffers.h [None][refactor] decoding inputs, part 2 (#5799) 2025-11-18 14:38:51 +01:00
evictionPolicy.h [TLLM-6777][feature] Support SWA KV cache reuse OOW block detach (#7922) 2025-10-13 09:18:12 -07:00
guidedDecoder.h refactor: Enhanced handling of decoder requests and logits within the batch manager (#6055) 2025-07-18 12:12:08 +02:00
handleContextLogits.h
handleGenerationLogits.h
kvCacheConnector.h [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00
kvCacheEventManager.h [TRTLLM-6881][feat] Include attention dp rank info with KV cache events (#6563) 2025-08-07 14:17:07 +02:00
kvCacheManager.h [https://nvbugs/5721661][fix] Prevent out-of-bounds read (#9879) 2026-01-15 10:51:40 -06:00
kvCacheTransferManager.h [https://nvbugs/5627710][fix] Fix synchronization bugs in KvCacheTransferManager that can cause corrupted blocks (#9056) 2025-12-02 09:10:21 -06:00
kvCacheType.h
kvCacheUtils.h [None][feat] Add support for KVCache reuse for DSv32 (#9383) 2025-12-02 11:14:30 +08:00
llmRequest.h [TRTLLM-9942][feat] new request states and kvcache transceiver APIs in generation-first disagg (#10406) 2026-01-15 19:18:21 +08:00
logitsPostProcessor.h [None][chore] Mass integration of release/1.0 - 3rd (#7519) 2025-09-08 14:03:04 +08:00
makeDecodingBatchInputOutput.h [None][refactor] decoding inputs, part 2 (#5799) 2025-11-18 14:38:51 +01:00
medusaBuffers.h
microBatchScheduler.h
pauseRequests.h
peftCacheManager.h
peftCacheManagerConfig.h
promptTuningBuffers.h
rnnStateManager.h
runtimeBuffers.h Revert "feat: nanobind bindings (#5961)" (#6160) 2025-07-18 10:12:54 +08:00
sequenceSlotManager.h
transformerBuffers.h
updateDecoderBuffers.h