TensorRT-LLMs/cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv
Kaiyu Xie aaacc9bd68
Update TensorRT-LLM (#2562)
* Update TensorRT-LLM

---------

Co-authored-by: Starrick Liu <73152103+StarrickLiu@users.noreply.github.com>
2024-12-11 00:31:05 -08:00
..
common.h Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
converter.h Update TensorRT-LLM (#1315) 2024-03-19 17:36:42 +08:00
cudaCoreGemm.cu Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
cudaCoreGemm.h Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
details.h Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
int8SQ.cu Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
int8SQ.h Update TensorRT-LLM (#1358) 2024-03-26 20:47:14 +08:00
kernel.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcher.h Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherBf16Int8GroupwiseColumnMajoInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherBf16Int8GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8GroupwiseColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherFp16Int8GroupwiseColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedForHopperFalse.cu Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorTrue.cu Update TensorRT-LLM (#1492) 2024-04-24 14:44:22 +08:00
kernelLauncher.h Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
utility.h Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00