mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-04 18:21:52 +08:00
Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com> KVCacheManagerV2 is a new python-based implementation of the KV cache manager, featuring cleaner API, better abstraction and better code quality without the accumulated legacy. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include/tensorrt_llm | ||
| kernels | ||
| micro_benchmarks | ||
| tensorrt_llm | ||
| tests | ||
| CMakeLists.txt | ||
| conan.lock | ||
| conandata.yml | ||
| conanfile.py | ||
| libnuma_conan.py | ||