TensorRT-LLMs/cpp/include/tensorrt_llm/executor
Chuang Zhu 4cc4cbe926
[https://nvbugs/5716787][fix] terminate nixl running when exiting (#9785)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Co-authored-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>
2025-12-12 11:15:02 -05:00
..
cacheCommunicator.h [https://nvbugs/5716787][fix] terminate nixl running when exiting (#9785) 2025-12-12 11:15:02 -05:00
dataTransceiverState.h [TRTLLM-8540][feat] Add support for disagg in DSv3.2 (#8735) 2025-11-12 08:21:11 -08:00
disaggServerUtil.h Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
executor.h [None][feat] Have ability to cancel disagg request if KV cache resource are exhausted (#9155) 2025-11-18 20:59:17 -05:00
serialization.h [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
tensor.h Update TensorRT-LLM (#1918) 2024-07-09 14:42:22 +08:00
transferAgent.h [None][doc] Facilitates the integration of the transfer agent (#7867) 2025-10-21 20:06:24 +08:00
types.h [None][feat] add detailed KV cache transfer time breakdown (#8521) 2025-10-29 10:11:09 +08:00