kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
77657a1c12
TensorRT-LLMs/cpp/tensorrt_llm/executor/cache_transmission
History
Chuang Zhu 77657a1c12
[TRTLLM-7361][feat] KV cache transfer for uneven pp (#7117) 
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-09-08 13:37:46 -04:00
..
agent_utils [TRTLLM-7361][feat] KV cache transfer for uneven pp (#7117) 2025-09-08 13:37:46 -04:00
mpi_utils feat: NIXL interface integration (#3934) 2025-05-19 18:18:22 +08:00
nixl_utils use file lock to avoid port conflict (#5123) 2025-06-16 14:15:37 +08:00
ucx_utils [None][feat] Add Request specific exception (#6931) 2025-09-04 18:43:42 -04:00
cacheSplitConcat.cu [TRTLLM-7361][feat] KV cache transfer for uneven pp (#7117) 2025-09-08 13:37:46 -04:00
cacheSplitConcat.h [TRTLLM-7361][feat] KV cache transfer for uneven pp (#7117) 2025-09-08 13:37:46 -04:00
transferAgent.cpp Agent interface impl for NIXL (#4125) 2025-05-22 09:09:41 +08:00