TensorRT-LLMs/cpp/tensorrt_llm
Chuang Zhu e2318756ed
cacheTransceiver buffer manager (#3798)
* cacheTransceiver buffer manager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* fix args

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* cpp kvCacheManager

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

* format

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

---------

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-04-27 11:48:15 +08:00
..
batch_manager cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
common cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: Add head size 72 support for QKV Preprocessing kernel (#3743) 2025-04-25 11:07:40 -07:00
layers fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
plugins refactor: Clean up CMakeLists.txt (#3479) 2025-04-18 14:39:29 +08:00
pybind cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
runtime fix: 5197419 and removed unused runtime kernels (#3631) 2025-04-23 18:04:50 +02:00
thop feat: Add MNNVL MoE A2A support (#3504) 2025-04-25 17:29:08 +08:00
CMakeLists.txt Fix double link to fp8_blockscale_gemm_src (#3707) 2025-04-23 10:16:07 +08:00