TensorRT-LLMs/cpp/include/tensorrt_llm/executor
Patrice Castonguay 9b0f45298f
[None][feat] Have ability to cancel disagg request if KV cache resource are exhausted (#9155)
Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>
2025-11-18 20:59:17 -05:00
..
cacheCommunicator.h Agent interface impl for NIXL (#4125) 2025-05-22 09:09:41 +08:00
dataTransceiverState.h [TRTLLM-8540][feat] Add support for disagg in DSv3.2 (#8735) 2025-11-12 08:21:11 -08:00
disaggServerUtil.h Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
executor.h [None][feat] Have ability to cancel disagg request if KV cache resource are exhausted (#9155) 2025-11-18 20:59:17 -05:00
serialization.h [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
tensor.h Update TensorRT-LLM (#1918) 2024-07-09 14:42:22 +08:00
transferAgent.h [None][doc] Facilitates the integration of the transfer agent (#7867) 2025-10-21 20:06:24 +08:00
types.h [None][feat] add detailed KV cache transfer time breakdown (#8521) 2025-10-29 10:11:09 +08:00