kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-22 19:52:38 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
93293aa46d
TensorRT-LLMs/cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv
History
Kaiyu Xie bca9a33b02
Update TensorRT-LLM (#2008) 
* Update TensorRT-LLM

---------

Co-authored-by: Timur Abishev <abishev.timur@gmail.com>
Co-authored-by: MahmoudAshraf97 <hassouna97.ma@gmail.com>
Co-authored-by: Saeyoon Oh <saeyoon.oh@furiosa.ai>
Co-authored-by: hattizai <hattizai@gmail.com>
2024-07-23 23:05:09 +08:00
..
common.h Update TensorRT-LLM (#1315) 2024-03-19 17:36:42 +08:00
converter.h Update TensorRT-LLM (#1315) 2024-03-19 17:36:42 +08:00
cudaCoreGemm.cu Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
cudaCoreGemm.h Update TensorRT-LLM (#2008) 2024-07-23 23:05:09 +08:00
details.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
int8SQ.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
int8SQ.h Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
kernel.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcher.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorFalse.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelLauncher.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
utility.h Update TensorRT-LLM (#1688) 2024-05-28 20:07:49 +08:00