Robin Kobus 93a54457ac [nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621) ... - Moved sorting related logic to a dedicated function for better clarity and maintainability. - Enhanced sorting logic to separate finished context requests from ongoing ones before sorting by Lora task ID. - Updated function documentation to reflect the sorting behavior and its purpose. Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>		2025-05-26 17:10:55 +08:00
..
batch_manager	[nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621)	2025-05-26 17:10:55 +08:00
common	Feat: add sliding-window-attention generation-phase kernels on Blackwell (#4564)	2025-05-26 09:06:33 +08:00
cutlass_extensions/include/cutlass_extensions	chore: guardword clean for header file. (#4540)	2025-05-23 10:08:14 +08:00
executor	fix: Handle additional model outputs based on pipeline parallel rank (#4498)	2025-05-26 09:04:40 +02:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	Feat: add sliding-window-attention generation-phase kernels on Blackwell (#4564)	2025-05-26 09:06:33 +08:00
layers	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
plugins	Fix bias shape in weightOnlyGroupwiseQuantMatmulPlugin for TRT workflow (#4348)	2025-05-16 10:02:30 +08:00
pybind	Fix snake case format (#4559)	2025-05-25 17:57:17 +08:00
runtime	fix[nvbug-5295425]: [TRTLLM-5385] fix race condition in MoeLoadBalancer (#4573)	2025-05-23 09:24:23 +08:00
testing	refactor: Move ModelSpec to core library (#3980)	2025-05-04 01:39:09 +08:00
thop	[TRTLLM-5070][feat] Support FP8 KV Cache Reuse for MLA (#4535)	2025-05-23 19:47:50 +08:00
CMakeLists.txt	feat: NIXL interface integration (#3934)	2025-05-19 18:18:22 +08:00