TensorRT-LLMs/cpp/tensorrt_llm
Chuang Zhu 09a28becae
fix cache buffer (#3942)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
2025-05-07 09:49:44 +08:00
..
batch_manager fix cache buffer (#3942) 2025-05-07 09:49:44 +08:00
common [fix] Skip debugCheckSemaphores in stream capture mode (#4032) 2025-05-05 10:24:10 -07:00
cutlass_extensions/include/cutlass_extensions TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770) 2025-04-29 11:19:11 -04:00
executor fix cache buffer (#3942) 2025-05-07 09:49:44 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
layers fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
plugins feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
pybind fix: Properly get decoding mode according to same logic as cpp. (#4026) 2025-05-06 21:53:17 +08:00
runtime [TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625) 2025-05-06 15:06:46 +02:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
thop feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
CMakeLists.txt feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00