kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
93a54457ac
TensorRT-LLMs/cpp/tensorrt_llm/batch_manager/utils
History
Robin Kobus 93a54457ac
[nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621) 
- Moved sorting related logic to a dedicated function for better clarity and maintainability.
- Enhanced sorting logic to separate finished context requests from ongoing ones before sorting by Lora task ID.
- Updated function documentation to reflect the sorting behavior and its purpose.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-05-26 17:10:55 +08:00
..
debugUtils.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
debugUtils.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
inflightBatchingUtils.cpp [nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621) 2025-05-26 17:10:55 +08:00
inflightBatchingUtils.h [nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621) 2025-05-26 17:10:55 +08:00
logitsThread.cpp refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
logitsThread.h refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
staticThreadPool.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
staticThreadPool.h Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00