Yueh-Ting (eop) Chen 199f306984 [None][chore][kv cache manager] Dead code elimination, we no longer record/fetch through WindowBlockManager:: mContextBlocksByHash (#6249) ... No functional change is intended in this MR. `WindowBlockManager::mCachedBlocksRoot` is now who is responsible for the bookkeeping of the `KVCacheBlock`, and the `mNextBlocks` is now the actual hash map that fetches the block. The `mEnableHashKey` knob and related hashing is removed. Signed-off-by: eopXD <yuehtingc@nvidia.com>		2025-08-10 09:10:10 -04:00
..
allocateKvCache.h	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
assignReqSeqSlots.h	Update TensorRT-LLM (#2436)	2024-11-12 15:27:49 +08:00
cacheTransceiver.h	chore:[BREAKING CHANGE] use cacheTransceiverConfig as knobs for disagg service (#5234)	2025-07-17 17:42:07 +08:00
capacityScheduler.h	fix: max_num_sequences calculation with overlap scheduling (#4532)	2025-06-03 09:31:22 +02:00
common.h	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (#2297)	2024-10-08 12:19:19 +02:00
contextProgress.h	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
createNewDecoderRequests.h	refactor: Unify decoder test with e2e worklfow (#5239)	2025-06-17 12:04:58 +02:00
decoderBuffers.h	refactor: Enhanced handling of decoder requests and logits within the batch manager (#6055)	2025-07-18 12:12:08 +02:00
evictionPolicy.h	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
guidedDecoder.h	refactor: Enhanced handling of decoder requests and logits within the batch manager (#6055)	2025-07-18 12:12:08 +02:00
handleContextLogits.h	refactor: Speculative decoding buffers part 2 (#5316)	2025-06-27 17:41:48 +02:00
handleGenerationLogits.h	refactor: Speculative decoding buffers part 2 (#5316)	2025-06-27 17:41:48 +02:00
kvCacheEventManager.h	[TRTLLM-6881][feat] Include attention dp rank info with KV cache events (#6563)	2025-08-07 14:17:07 +02:00
kvCacheManager.h	[None][chore][kv cache manager] Dead code elimination, we no longer record/fetch through WindowBlockManager:: mContextBlocksByHash (#6249)	2025-08-10 09:10:10 -04:00
kvCacheTransferManager.h	feature: KV Cache GPUDirect Storage (#3209)	2025-05-28 23:27:43 +00:00
kvCacheType.h	refactor: remove batch_manager::KvCacheConfig and use executor::KvCacheConfig instead (#5384)	2025-06-26 19:45:52 +08:00
kvCacheUtils.h	feat: cache reuse support (selective cache transfer) in mla cache formatter (#4749)	2025-06-04 09:56:31 +08:00
llmRequest.h	[TRTLLM-6637][feat] Resolve KV cache divergence issue (#6628)	2025-08-09 23:15:04 +08:00
logitsPostProcessor.h	refactor: Enhanced handling of decoder requests and logits within the batch manager (#6055)	2025-07-18 12:12:08 +02:00
makeDecodingBatchInputOutput.h	refactor: Enhanced handling of decoder requests and logits within the batch manager (#6055)	2025-07-18 12:12:08 +02:00
medusaBuffers.h	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
microBatchScheduler.h	[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)	2025-05-06 15:06:46 +02:00
pauseRequests.h	Update TensorRT-LLM (#2532)	2024-12-04 21:16:56 +08:00
peftCacheManager.h	Update TensorRT-LLM (#2783)	2025-02-13 18:40:22 +08:00
peftCacheManagerConfig.h	Update TensorRT-LLM (#2755)	2025-02-11 03:01:00 +00:00
promptTuningBuffers.h	feat: Offloading Multimodal embedding table to CPU in Chunked Prefill Mode (#3380)	2025-04-21 14:31:01 +08:00
rnnStateManager.h	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
runtimeBuffers.h	Revert "feat: nanobind bindings (#5961)" (#6160)	2025-07-18 10:12:54 +08:00
sequenceSlotManager.h	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
transformerBuffers.h	refactor: remove batch_manager::KvCacheConfig and use executor::KvCacheConfig instead (#5384)	2025-06-26 19:45:52 +08:00
updateDecoderBuffers.h	refactor: Speculative decoding buffers part 2 (#5316)	2025-06-27 17:41:48 +02:00