TensorRT-LLMs/cpp/tensorrt_llm/executor
Robin Kobus d31fefde2c
[TRTLLM-5171] chore: Remove GptSession/V1 from TRT workflow (#4092)
* chore: Remove GptSession/V1 from TRT workflow

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove stateful decoders

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove GptSession buffers

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove GptSession utils

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove GptSession kernels

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove V1 GPT models from tests

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove gptSessionBenchmark from scripts and docs

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove gptSession IO classes

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove GptSession from test lists

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove GptSession from docs

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove useless encoder test

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove mActualBatchSize from DecoderState

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

* chore: Remove static batching from ExecutorTest

- Updated `validateContextLogits` and `validateGenerationLogits` functions to remove the `batchingType` parameter.
- Adjusted related test functions to reflect the changes in parameter lists.
- Cleaned up the instantiation of test cases to eliminate unnecessary batchingType references.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>

---------

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-05-14 23:10:04 +02:00
..
cache_transmission fix cache buffer (#3942) 2025-05-07 09:49:44 +08:00
cacheTransceiverConfig.cpp [TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625) 2025-05-06 15:06:46 +02:00
CMakeLists.txt cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
contextPhaseParams.cpp Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
debugConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
decodingConfig.cpp Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
disaggServerUtil.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
dynamicBatchConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
dynamicBatchTuner.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
dynamicBatchTuner.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executor.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executorConfig.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
executorImpl.cpp [TRTLLM-5171] chore: Remove GptSession/V1 from TRT workflow (#4092) 2025-05-14 23:10:04 +02:00
executorImpl.h refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
executorKVCacheEventManager.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
extendedRuntimePerfKnobConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
guidedDecodingConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
guidedDecodingParams.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
intervalSet.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
jsonSerialization.cpp feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
kvCacheConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
kvCacheRetentionConfig.cpp chore: Clean up cpp runtime (#3537) 2025-04-15 16:06:14 +08:00
logitsPostProcessorConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
loraConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
model.h fix: request termination in pipeline parallelism (#3892) 2025-05-05 21:51:41 +08:00
mropeConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
orchestratorConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
orchestratorUtils.h refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
outputConfig.cpp [TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625) 2025-05-06 15:06:46 +02:00
parallelConfig.cpp feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00
peftCacheConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
promptTuningConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
request.cpp chore: Cleanup deprecated APIs from LLM-API (part 1/2) (#3732) 2025-05-07 13:20:25 +08:00
requestImpl.h feat: Add multimodal embedding field in LlmRequest (#3855) 2025-05-01 12:23:30 +08:00
requestUtils.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
requestUtils.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
requestWithId.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
requestWithId.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
response.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
responseImpl.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
samplingConfig.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
schedulerConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
serialization.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
serializeUtils.h cacheTransceiver buffer manager (#3798) 2025-04-27 11:48:15 +08:00
speculativeDecodingConfig.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
tensor.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
types.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00