TensorRT-LLMs/cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv
Kaiyu Xie 9bd15f1937
TensorRT-LLM v0.10 update
* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <lokravi@amazon.com>
Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>
2024-06-05 20:43:25 +08:00
..
common.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
converter.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
details.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
int8SQ.cu Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
int8SQ.h Update TensorRT-LLM Release branch (#1445) 2024-04-12 17:59:19 +08:00
kernel.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcher.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int4GroupwiseColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int4PerChannelColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherBf16Int8PerChannelColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int4GroupwiseColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int4PerChannelColumnMajorTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorFalse.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorInterleavedTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelDispatcherFp16Int8PerChannelColumnMajorTrue.cu TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
kernelLauncher.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00
utility.h TensorRT-LLM v0.10 update 2024-06-05 20:43:25 +08:00