TensorRT-LLMs/cpp/include/tensorrt_llm/runtime
Balaram Buddharaju a792c23dcf
[TRTLLM-9465][fix] Swap TP-CP grouping order (#10350)
Signed-off-by: Balaram Buddharaju <169953907+brb-nv@users.noreply.github.com>
2026-01-05 20:08:03 +08:00
..
utils [TRTLLM-7349][feat] Adding new orchestrator type -- ray (#7520) 2025-10-04 08:12:24 +08:00
bufferManager.h
common.h [TRTLLM-7398][feat] Support KV cache salting for secure KV cache reuse (#7106) 2025-09-06 17:58:32 -04:00
cudaEvent.h
cudaStream.h
decoderState.h [None][refactor] Simplify decoder state initialization (#6559) 2025-08-12 21:44:41 +02:00
decodingInput.h [None][refactor] Simplify decoder state initialization for speculative decoding (#6869) 2025-08-22 18:44:17 +02:00
decodingOutput.h refactor: Clean up DecodingInput and DecodingOutput (#5617) 2025-07-01 14:31:42 +02:00
eagleBuffers.h
eagleModule.h
explicitDraftTokensBuffers.h
gptDecoder.h [TRTLLM-6785][feat] BREAKING CHANGE Enable TRTLLM sampler by default (#6216) 2025-08-07 22:19:37 -04:00
gptDecoderBatched.h [None][refactor] decoding inputs, part 2 (#5799) 2025-11-18 14:38:51 +01:00
gptJsonConfig.h
iBuffer.h
iGptDecoderBatched.h [None][refactor] decoding inputs, part 2 (#5799) 2025-11-18 14:38:51 +01:00
ipcNvlsMemory.h
ipcUtils.h
iTensor.h [TRTLLM-9086][doc] Clean up TODOs in documentation (#9292) 2025-12-05 17:50:12 -05:00
lookaheadBuffers.h
lookaheadModule.h [None] [refactor] Minor cleanup and improvements (#7619) 2025-10-03 11:40:06 +02:00
loraCache.h
loraCachePageManagerConfig.h
loraModule.h
medusaModule.h
memoryCounters.h
modelConfig.h [None] [refactor] Minor cleanup and improvements (#7619) 2025-10-03 11:40:06 +02:00
promptTuningParams.h
rawEngine.h
runtimeDefaults.h
samplingConfig.h [None][feat] Support ignored prompt length for penalties via new sampling config parameter (#8127) 2025-10-27 13:12:31 -04:00
speculativeDecodingMode.h
speculativeDecodingModule.h
tllmLogger.h
virtualMemory.h [None][fix] Correct virtual memory allocation alignment (#9491) 2025-12-01 10:59:19 +08:00
worldConfig.h [TRTLLM-9465][fix] Swap TP-CP grouping order (#10350) 2026-01-05 20:08:03 +08:00