kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-05 02:31:33 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
d6f76d2fae
TensorRT-LLMs/cpp/tensorrt_llm/nanobind/common
History
Yao Yao 6f07fa81d7
[TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 
Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com>

KVCacheManagerV2 is a new python-based implementation of the KV cache manager, featuring cleaner API, better abstraction and better code quality without the accumulated legacy.
2026-01-24 04:48:39 -05:00
..
bindTypes.h fix: bindings unit tests for nanobind (#6221) 2025-07-22 14:51:43 +01:00
customCasters.h [TRTLLM-7738][feat] Adding implementation of KVCacheManagerV2 (#10736) 2026-01-24 04:48:39 -05:00
tllmExceptions.cpp [None][feat] Add Request specific exception (#6931) 2025-09-04 18:43:42 -04:00
tllmExceptions.h [None][feat] Add Request specific exception (#6931) 2025-09-04 18:43:42 -04:00