kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-13 22:18:36 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
main
TensorRT-LLMs/cpp/tensorrt_llm/batch_manager/utils
History
Iman Tabrizian 33282351a2
[TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 
Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
2025-09-27 19:29:30 -04:00
..
debugUtils.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
debugUtils.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
inflightBatchingUtils.cpp [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
inflightBatchingUtils.h refactor: unique_ptr instead of shared_ptr (#4697) 2025-05-29 22:49:35 +02:00
logitsThread.cpp [None][refactor] Simplify decoder state initialization for speculative decoding (#6869) 2025-08-22 18:44:17 +02:00
logitsThread.h [None][refactor] Simplify decoder state initialization for speculative decoding (#6869) 2025-08-22 18:44:17 +02:00
staticThreadPool.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
staticThreadPool.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00