Robin Kobus b5bc0a9fcd chore: Add output of first token to additional generation outputs (#3205) ... - Updated the first dimension of additional output tensors to match mMaxNewTokens. - Copy output of last context token to generation outputs. - Adjusted the expected output size calculations in unit tests to reflect the correct maximum output length. Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>		2025-04-02 20:14:16 +08:00
..
cmake	fix #3109: early exit cmake if find_library() does not find any lib (#3113)	2025-03-29 19:59:03 +08:00
include/tensorrt_llm	chore: Add output of first token to additional generation outputs (#3205)	2025-04-02 20:14:16 +08:00
micro_benchmarks	perf: Add optimizations for deepseek in min latency mode (#3093)	2025-04-02 09:05:24 +08:00
tensorrt_llm	chore: Add output of first token to additional generation outputs (#3205)	2025-04-02 20:14:16 +08:00
tests	chore: Add output of first token to additional generation outputs (#3205)	2025-04-02 20:14:16 +08:00
CMakeLists.txt	fix: upgrade cmake minimum from 3.18 to 3.27 (#3208)	2025-04-02 15:14:36 +08:00