TensorRT-LLMs/cpp/tensorrt_llm/executor
2026-02-12 00:48:47 -05:00
..
cache_transmission [TRTLLM-10793][feat] Add BOLT compatible build flags for further experimental usage. (#11297) 2026-02-12 09:54:58 +08:00
cacheTransceiverConfig.cpp [None][feat] Have ability to cancel disagg request if KV cache resource are exhausted (#9155) 2025-11-18 20:59:17 -05:00
CMakeLists.txt [TRTLLM-9527][feat] Add transferAgent binding (step 1) (#10113) 2026-01-06 08:40:38 +08:00
contextPhaseParams.cpp [TRTLLM-9527][feat] change context params and disagg params (step3) (#10495) 2026-01-27 16:34:17 +08:00
debugConfig.cpp
decodingConfig.cpp
disaggServerUtil.cpp
dynamicBatchConfig.cpp
dynamicBatchTuner.cpp
dynamicBatchTuner.h
executor.cpp [TRTLLM-6881][feat] Include attention dp rank info with KV cache events (#6563) 2025-08-07 14:17:07 +02:00
executorConfig.cpp [nvbug/5374773] chore: Add a runtime flag to enable fail fast when attn window is too large to fit at least one sequence in KV cache (#5974) 2025-07-25 18:10:40 -04:00
executorImpl.cpp [TRTLLM-10059][feat] Use global unique id as disagg request id (#10187) 2026-01-21 22:52:34 -05:00
executorImpl.h [TRTLLM-10059][feat] Use global unique id as disagg request id (#10187) 2026-01-21 22:52:34 -05:00
executorKVCacheEventManager.cpp
extendedRuntimePerfKnobConfig.cpp
guidedDecodingConfig.cpp
guidedDecodingParams.cpp
intervalSet.h
jsonSerialization.cpp [TRTLLM-5000][feat] NGrams V2 (#4569) 2025-06-27 23:00:17 +08:00
kvCacheConfig.cpp fix/improve kvcache allocation in PyTorch runtime (#5933) 2025-08-26 12:40:22 +08:00
kvCacheRetentionConfig.cpp [None][feat] Nixl support for GDS (#5488) 2025-09-09 13:00:38 +08:00
logitsPostProcessorConfig.cpp
loraConfig.cpp [TRTLLM-6683][feat] Support LoRA reload CPU cache evicted adapter (#6510) 2025-08-07 09:05:36 +03:00
model.h fix: request termination in pipeline parallelism (#3892) 2025-05-05 21:51:41 +08:00
mropeConfig.cpp
multimodalInput.cpp [TRTLLM-10487][feat] Add user-provided UUID support for multimodal KV cache identification. (#11075) 2026-02-12 00:48:47 -05:00
orchestratorConfig.cpp
orchestratorUtils.h refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
outputConfig.cpp [TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625) 2025-05-06 15:06:46 +02:00
parallelConfig.cpp feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00
peftCacheConfig.cpp
promptTuningConfig.cpp
request.cpp [TRTLLM-10059][feat] Use global unique id as disagg request id (#10187) 2026-01-21 22:52:34 -05:00
requestImpl.h [TRTLLM-10059][feat] Use global unique id as disagg request id (#10187) 2026-01-21 22:52:34 -05:00
requestUtils.cpp
requestUtils.h
requestWithId.cpp
requestWithId.h
response.cpp
responseImpl.h
samplingConfig.cpp [None][feat] Support ignored prompt length for penalties via new sampling config parameter (#8127) 2025-10-27 13:12:31 -04:00
schedulerConfig.cpp
serialization.cpp [TRTLLM-10487][feat] Add user-provided UUID support for multimodal KV cache identification. (#11075) 2026-02-12 00:48:47 -05:00
serializeUtils.h [TRTLLM-10487][feat] Add user-provided UUID support for multimodal KV cache identification. (#11075) 2026-02-12 00:48:47 -05:00
speculativeDecodingConfig.cpp
tensor.cpp [TRTLLM-4629] [feat] Add support of CUDA13 and sm103 devices (#7568) 2025-09-16 09:56:18 +08:00
types.cpp