Yao Yao 6f07fa81d7 [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) ... Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com> KVCacheManagerV2 is a new python-based implementation of the KV cache manager, featuring cleaner API, better abstraction and better code quality without the accumulated legacy.		2026-01-24 04:48:39 -05:00
..
algorithms.cpp	[TRTLLM-8831][feat] Enable early exit with overlap scheduler (#8587)	2025-11-17 18:07:13 +01:00
algorithms.h	feat: nanobind bindings (#6185)	2025-07-21 08:56:57 +01:00
bindings.cpp	[None][fix] Avoid Double update for previous batch (#9888)	2026-01-22 13:15:06 -05:00
bindings.h	feat: nanobind bindings (#6185)	2025-07-21 08:56:57 +01:00
buffers.cpp	[None][refactor] decoding inputs, part 2 (#5799)	2025-11-18 14:38:51 +01:00
buffers.h	[None][refactor] decoding inputs, part 2 (#5799)	2025-11-18 14:38:51 +01:00
cacheTransceiver.cpp	[None][chore] Async Transfer Manager (#9891)	2026-01-20 12:12:47 -05:00
cacheTransceiver.h	feat: nanobind bindings (#6185)	2025-07-21 08:56:57 +01:00
kvCacheConnector.cpp	[None][feat] KV Cache Connector API (#7228)	2025-08-28 23:09:27 -04:00
kvCacheConnector.h	[None][feat] KV Cache Connector API (#7228)	2025-08-28 23:09:27 -04:00
kvCacheManager.cpp	[https://nvbugs/5322131][feat] Multi-LoRA serving with CUDA Graph (#8279)	2026-01-22 14:01:18 +01:00
kvCacheManager.h	feat: nanobind bindings (#6185)	2025-07-21 08:56:57 +01:00
kvCacheManagerV2Utils.cpp	[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736)	2026-01-24 04:48:39 -05:00
kvCacheManagerV2Utils.h	[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736)	2026-01-24 04:48:39 -05:00
llmRequest.cpp	[None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553)	2025-09-15 07:26:01 -04:00
llmRequest.h	[None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553)	2025-09-15 07:26:01 -04:00