kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
d138795485
TensorRT-LLMs/cpp/tests/unit_tests
History
Robin Kobus b5bc0a9fcd
chore: Add output of first token to additional generation outputs (#3205) 
- Updated the first dimension of additional output tensors to match mMaxNewTokens.
- Copy output of last context token to generation outputs.
- Adjusted the expected output size calculations in unit tests to reflect the correct maximum output length.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-04-02 20:14:16 +08:00
..
batch_manager fix: remove test relies on timing (#3228) 2025-04-02 18:38:37 +08:00
common fix: segfault in cudaDriverWrapper (#3017) 2025-04-02 08:55:19 +02:00
executor chore: Add output of first token to additional generation outputs (#3205) 2025-04-02 20:14:16 +08:00
kernels perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
layers feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133) 2025-04-02 12:31:28 +08:00
runtime v1.2 (#3082) 2025-03-26 23:31:29 +08:00
thop Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
utils Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
CMakeLists.txt Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00