kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-05 02:31:33 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
c761b68481
TensorRT-LLMs/tensorrt_llm/runtime/kv_cache_manager_v2
History
Yao Yao 6f07fa81d7
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 
Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com>

KVCacheManagerV2 is a new python-based implementation of the KV cache manager, featuring cleaner API, better abstraction and better code quality without the accumulated legacy.
2026-01-24 04:48:39 -05:00
..
_core [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_eviction_controller [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_storage [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
rawref [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
__init__.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
__init__.pyi [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_block_radix_tree.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_common.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_config.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_copy_engine.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_cuda_virt_mem.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_exceptions.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_life_cycle_registry.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_page.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_storage_manager.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_utils.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
Makefile [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
mypy_mypyc.ini [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
setup_mypyc.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00