Michal Guzek 08d57123f9 [nvbug/5374773] chore: Add a runtime flag to enable fail fast when attn window is too large to fit at least one sequence in KV cache (#5974) ... Signed-off-by: moraxu <mguzek@nvidia.com>		2025-07-25 18:10:40 -04:00
..
batch_manager	[TRTLLM-5059][feat] Add KV cache reuse support for multimodal models (#5444)	2025-07-21 16:11:58 -07:00
common	[TRTLLM-5366][feat]Add support for sm121 (#5524)	2025-07-08 14:27:00 -07:00
deep_gemm	fix: fix license bug (#5200)	2025-06-13 18:58:15 +08:00
executor	[nvbug/5374773] chore: Add a runtime flag to enable fail fast when attn window is too large to fit at least one sequence in KV cache (#5974)	2025-07-25 18:10:40 -04:00
kernels	feat: reduce unnecessary kernel generation (#5476)	2025-07-04 14:37:49 +08:00
layers	v1.2 (#3082)	2025-03-26 23:31:29 +08:00
plugins/api	Update TensorRT-LLM (#2532)	2024-12-04 21:16:56 +08:00
runtime	refactor: decoding inputs (#5679)	2025-07-06 08:21:02 +02:00