TensorRT-LLMs/cpp/tests/unit_tests/executor
Robin Kobus b5bc0a9fcd
chore: Add output of first token to additional generation outputs (#3205)
- Updated the first dimension of additional output tensors to match mMaxNewTokens.
- Copy output of last context token to generation outputs.
- Adjusted the expected output size calculations in unit tests to reflect the correct maximum output length.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-04-02 20:14:16 +08:00
..
CMakeLists.txt chore: Add output of first token to additional generation outputs (#3205) 2025-04-02 20:14:16 +08:00
decodingConfigTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
dynamicBatchTunerTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executorConfigTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executorTestSmall.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executorTestSmallArbitraryOutputTensors.cpp chore: Add output of first token to additional generation outputs (#3205) 2025-04-02 20:14:16 +08:00
intervalSetTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
kvCacheConfigTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
loraConfigTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
requestTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
requestWithIdTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
responseTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
samplingConfigTest.cpp v1.2 (#3082) 2025-03-26 23:31:29 +08:00
serializeUtilsTest.cpp feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
tensorTest.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
ucxCommTest.cpp chore: Ucx ip port remove mpi depend (#3101) 2025-04-02 09:42:29 +08:00