TensorRT-LLMs/cpp/tensorrt_llm/pybind/executor
Chuang Zhu e2318756ed
cacheTransceiver buffer manager (#3798)
* cacheTransceiver buffer manager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* fix args

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* cpp kvCacheManager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* format

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

---------

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-04-27 11:48:15 +08:00
..
bindings.cpp feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
bindings.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
executor.cpp Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
executor.h Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
executorConfig.cpp cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
executorConfig.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
request.cpp feat: Allow individual gatherContext for each additional output (#3374) 2025-04-12 17:00:36 +08:00
request.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
streamCaster.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
tensorCaster.h Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00