kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
3e37531c6a
TensorRT-LLMs/cpp/tensorrt_llm
History
BatshevaBlack 3e37531c6a
feat: Add BW measurement (#3070)
2025-03-28 10:53:00 +08:00
..
batch_manager feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
common fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels v1.2 (#3082) 2025-03-26 23:31:29 +08:00
layers v1.2 (#3082) 2025-03-26 23:31:29 +08:00
plugins fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
pybind feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
runtime refactor: simplify forward methods in GptDecoderBatched (#3076) 2025-03-26 20:45:04 +08:00
thop v1.2 (#3082) 2025-03-26 23:31:29 +08:00
CMakeLists.txt Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00