TensorRT-LLMs/cpp/tensorrt_llm/pybind
Chuang Zhu e2318756ed
cacheTransceiver buffer manager (#3798)
* cacheTransceiver buffer manager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* fix args

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* cpp kvCacheManager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* format

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

---------

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-04-27 11:48:15 +08:00
..
batch_manager cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
common fix: Fix C++ decoder synchronization in PyTorch (#3106) 2025-04-23 23:55:27 +08:00
executor cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
runtime fix: Fix C++ decoder synchronization in PyTorch (#3106) 2025-04-23 23:55:27 +08:00
userbuffers feat: Introduce UB allocator for pytorch flow (#3257) 2025-04-08 18:39:49 +08:00
bindings.cpp cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
CMakeLists.txt Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00