kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
1901bfcf76
TensorRT-LLMs/cpp/tensorrt_llm
History
liji-nv e0d0dde058
None - Add one-shot version for UB AR NORM FP16/BF16 (#2995) 
Signed-off-by: Jin Li <59594262+liji-nv@users.noreply.github.com>
2025-03-31 11:16:03 +08:00
..
batch_manager refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) 2025-03-28 14:50:52 +08:00
common fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
cutlass_extensions/include/cutlass_extensions feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
executor feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels None - Add one-shot version for UB AR NORM FP16/BF16 (#2995) 2025-03-31 11:16:03 +08:00
layers v1.2 (#3082) 2025-03-26 23:31:29 +08:00
plugins fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
pybind refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) 2025-03-28 14:50:52 +08:00
runtime refactor: Replace DecoderFinishedEvent with CudaEvent in decoder classes (#3078) 2025-03-28 14:50:52 +08:00
thop None - Add one-shot version for UB AR NORM FP16/BF16 (#2995) 2025-03-31 11:16:03 +08:00
CMakeLists.txt Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00