kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-05 02:31:33 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
13420178fc
TensorRT-LLMs/tensorrt_llm/runtime/kv_cache_manager_v2
History
Yi Zhang 0306c0f12c
[TRTLLM-9766][feat] Integration of the KVCacheManager V2 to TRTLLM Runtime (#10659) 
Signed-off-by: yizhang-nv <187001205+yizhang-nv@users.noreply.github.com>
2026-02-02 14:29:02 +08:00
..
_core [TRTLLM-9766][feat] Integration of the KVCacheManager V2 to TRTLLM Runtime (#10659) 2026-02-02 14:29:02 +08:00
_eviction_controller [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_storage [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
rawref [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
__init__.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
__init__.pyi [TRTLLM-9766][feat] Integration of the KVCacheManager V2 to TRTLLM Runtime (#10659) 2026-02-02 14:29:02 +08:00
_block_radix_tree.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_common.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
_config.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_copy_engine.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
_cuda_virt_mem.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
_exceptions.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_life_cycle_registry.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
_page.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
_storage_manager.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
_utils.py [None][feat] New KVCacheManagerV2 APIs for Transceiver (#11003) 2026-01-30 18:09:53 +08:00
Makefile [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
mypy_mypyc.ini [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
setup_mypyc.py [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00