TensorRT-LLMs/cpp/tensorrt_llm/executor/cache_transmission
Chuang Zhu e2318756ed
cacheTransceiver buffer manager (#3798)
* cacheTransceiver buffer manager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* fix args

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* cpp kvCacheManager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* format

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

---------

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-04-27 11:48:15 +08:00
..
mpi_utils chore: Ucx ip port remove mpi depend (#3101) 2025-04-02 09:42:29 +08:00
ucx_utils cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
cacheConcatenate.cu bug: Fix hang bug when context server doesn't have enough capacity for KV Cache (#3095) 2025-04-21 15:16:55 +08:00
cacheConcatenate.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00