TensorRT-LLMs/cpp/tensorrt_llm/nanobind/batch_manager
Chuang Zhu 2420918e5b
[TRTLLM-7078][chore] optimal kvcache transfer for VWSA (#7952)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-10-24 08:58:16 -04:00
..
algorithms.cpp [TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948) 2025-09-03 15:16:11 -07:00
algorithms.h feat: nanobind bindings (#6185) 2025-07-21 08:56:57 +01:00
bindings.cpp [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
bindings.h feat: nanobind bindings (#6185) 2025-07-21 08:56:57 +01:00
cacheTransceiver.cpp [TRTLLM-7078][chore] optimal kvcache transfer for VWSA (#7952) 2025-10-24 08:58:16 -04:00
cacheTransceiver.h feat: nanobind bindings (#6185) 2025-07-21 08:56:57 +01:00
kvCacheConnector.cpp [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00
kvCacheConnector.h [None][feat] KV Cache Connector API (#7228) 2025-08-28 23:09:27 -04:00
kvCacheManager.cpp [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
kvCacheManager.h feat: nanobind bindings (#6185) 2025-07-21 08:56:57 +01:00
llmRequest.cpp [None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553) 2025-09-15 07:26:01 -04:00
llmRequest.h [None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553) 2025-09-15 07:26:01 -04:00