kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
e2a8cbc80b
TensorRT-LLMs/cpp/tensorrt_llm
History
Robin Kobus e2a8cbc80b
refactor: manage cache indirection in decoder state (#5315) 
Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-06-24 09:15:59 +02:00
..
batch_manager refactor: manage cache indirection in decoder state (#5315) 2025-06-24 09:15:59 +02:00
common use file lock to avoid port conflict (#5123) 2025-06-16 14:15:37 +08:00
cutlass_extensions/include/cutlass_extensions refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00
executor refactor: remove TrtGptModelOptionalParams (#5165) 2025-06-20 10:31:40 +02:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels feat: Misc Opt for large scale EP (#5374) 2025-06-20 13:11:31 +08:00
layers Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
plugins [TRTLLM-5330] perf: Optimize MoE supplementary kernels for large-scale EP (#5215) 2025-06-17 15:23:24 +08:00
pybind refactor: manage cache indirection in decoder state (#5315) 2025-06-24 09:15:59 +02:00
runtime refactor: manage cache indirection in decoder state (#5315) 2025-06-24 09:15:59 +02:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
thop feat: Misc Opt for large scale EP (#5374) 2025-06-20 13:11:31 +08:00
CMakeLists.txt refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00