kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
20d0649f19
TensorRT-LLMs/cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv
History
Pamela Peng 6cdfc54883
feat: Add FP8 support for SM 120 (#3248) 
* Allow FP8 on SM120

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix sm121

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix pre-commit

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* review update

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

---------

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>
Co-authored-by: Sharan Chetlur <116769508+schetlur-nv@users.noreply.github.com>
2025-04-14 16:05:41 -07:00
..
common.h Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
converter.h feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
cudaCoreGemm.cu Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
cudaCoreGemm.h Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
details.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
int8SQ.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
int8SQ.h Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
kernel.h feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
kernelDispatcher.h feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int8GroupwiseColumnMajoInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherBf16Int8GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8GroupwiseColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherFp16Int8GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedForHopperTrue.cu Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelLauncher.h feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
utility.h feat: Update cutlass (#2981) 2025-03-26 22:36:27 +08:00