TensorRT-LLMs/cpp/tensorrt_llm
Robin Kobus e943ad5a2a
[https://nvbugs/5247414] fix: draft/target probs shape (#4055)
Shape was wrongly changed in DecoderState introduction.

Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-05-06 09:56:43 +02:00
..
batch_manager fix: request termination in pipeline parallelism (#3892) 2025-05-05 21:51:41 +08:00
common [fix] Skip debugCheckSemaphores in stream capture mode (#4032) 2025-05-05 10:24:10 -07:00
cutlass_extensions/include/cutlass_extensions TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770) 2025-04-29 11:19:11 -04:00
executor fix: request termination in pipeline parallelism (#3892) 2025-05-05 21:51:41 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
layers fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
plugins feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
pybind refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
runtime [https://nvbugs/5247414] fix: draft/target probs shape (#4055) 2025-05-06 09:56:43 +02:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
thop feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
CMakeLists.txt feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00