TensorRT-LLMs/cpp/tensorrt_llm/executor
Chuang Zhu 536a8f6a9c
[TRTLLM-9527][feat] Add transferAgent binding (step 1) (#10113)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2026-01-06 08:40:38 +08:00
..
cache_transmission [TRTLLM-9527][feat] Add transferAgent binding (step 1) (#10113) 2026-01-06 08:40:38 +08:00
cacheTransceiverConfig.cpp [None][feat] Have ability to cancel disagg request if KV cache resource are exhausted (#9155) 2025-11-18 20:59:17 -05:00
CMakeLists.txt [TRTLLM-9527][feat] Add transferAgent binding (step 1) (#10113) 2026-01-06 08:40:38 +08:00
contextPhaseParams.cpp
debugConfig.cpp
decodingConfig.cpp
disaggServerUtil.cpp
dynamicBatchConfig.cpp
dynamicBatchTuner.cpp
dynamicBatchTuner.h
executor.cpp [TRTLLM-6881][feat] Include attention dp rank info with KV cache events (#6563) 2025-08-07 14:17:07 +02:00
executorConfig.cpp [nvbug/5374773] chore: Add a runtime flag to enable fail fast when attn window is too large to fit at least one sequence in KV cache (#5974) 2025-07-25 18:10:40 -04:00
executorImpl.cpp [None][fix] Introduce inline namespace to avoid symbol collision (#9541) 2025-12-12 23:32:15 +08:00
executorImpl.h [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
executorKVCacheEventManager.cpp
extendedRuntimePerfKnobConfig.cpp
guidedDecodingConfig.cpp
guidedDecodingParams.cpp
intervalSet.h
jsonSerialization.cpp [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
kvCacheConfig.cpp fix/improve kvcache allocation in PyTorch runtime (#5933) 2025-08-26 12:40:22 +08:00
kvCacheRetentionConfig.cpp [None][feat] Nixl support for GDS (#5488) 2025-09-09 13:00:38 +08:00
logitsPostProcessorConfig.cpp
loraConfig.cpp [TRTLLM-6683][feat] Support LoRA reload CPU cache evicted adapter (#6510) 2025-08-07 09:05:36 +03:00
model.h
mropeConfig.cpp
multimodalInput.cpp [TRTLLM-5007][feat] Add multimodal hashing support (image hashing) (#4145) 2025-06-10 01:59:56 +08:00
orchestratorConfig.cpp
orchestratorUtils.h
outputConfig.cpp
parallelConfig.cpp
peftCacheConfig.cpp
promptTuningConfig.cpp
request.cpp [TRTLLM-7398][feat] Support KV cache salting for secure KV cache reuse (#7106) 2025-09-06 17:58:32 -04:00
requestImpl.h [TRTLLM-7398][feat] Support KV cache salting for secure KV cache reuse (#7106) 2025-09-06 17:58:32 -04:00
requestUtils.cpp
requestUtils.h
requestWithId.cpp
requestWithId.h
response.cpp
responseImpl.h
samplingConfig.cpp [None][feat] Support ignored prompt length for penalties via new sampling config parameter (#8127) 2025-10-27 13:12:31 -04:00
schedulerConfig.cpp
serialization.cpp [TRTLLM-9601][feat] Expose mmKeys for multimodal to integrate with dynamo. (#9604) 2025-12-15 08:42:30 +08:00
serializeUtils.h [TRTLLM-6106][feat] Add support for KVCache transfer from KVCache reuse path (#6348) 2025-09-27 19:29:30 -04:00
speculativeDecodingConfig.cpp
tensor.cpp [TRTLLM-4629] [feat] Add support of CUDA13 and sm103 devices (#7568) 2025-09-16 09:56:18 +08:00
types.cpp