kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
8b4104d34a
TensorRT-LLMs/cpp/tensorrt_llm/plugins
History
Omer Ullman Argov 8731f5f14f
chore: Mass integration of release/0.20 (#4898) 
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Signed-off-by: Yiqing Yan <yiqingy@nvidia.com>
Signed-off-by: Yuxian Qiu <142763828+yuxianq@users.noreply.github.com>
Signed-off-by: Hui Gao <huig@nvidia.com>
Signed-off-by: Balaram Buddharaju <169953907+brb-nv@users.noreply.github.com>
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
Signed-off-by: Ruodi <200874449+ruodil@users.noreply.github.com>
Signed-off-by: ruodil <200874449+ruodil@users.noreply.github.com>
Signed-off-by: Stanley Sun <190317771+StanleySun639@users.noreply.github.com>
Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>
Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com>
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
Signed-off-by: moraxu <mguzek@nvidia.com>
Signed-off-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>
Co-authored-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Yiqing Yan <yiqingy@nvidia.com>
Co-authored-by: Yuxian Qiu <142763828+yuxianq@users.noreply.github.com>
Co-authored-by: HuiGao-NV <huig@nvidia.com>
Co-authored-by: brb-nv <169953907+brb-nv@users.noreply.github.com>
Co-authored-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
Co-authored-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Co-authored-by: Iman Tabrizian <10105175+Tabrizian@users.noreply.github.com>
Co-authored-by: ruodil <200874449+ruodil@users.noreply.github.com>
Co-authored-by: Stanley Sun <190317771+StanleySun639@users.noreply.github.com>
Co-authored-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>
Co-authored-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com>
Co-authored-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Co-authored-by: Faraz <58580514+farazkh80@users.noreply.github.com>
Co-authored-by: Michal Guzek <moraxu@users.noreply.github.com>
Co-authored-by: Larry <197874197+LarryXFly@users.noreply.github.com>
Co-authored-by: Fanrong Li <23290157+lfr-0531@users.noreply.github.com>
Co-authored-by: Yechan Kim <161688079+yechank-nvidia@users.noreply.github.com>
2025-06-08 23:26:26 +08:00
..
api Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
bertAttentionPlugin Support RingAttention in the BertAttention plugin and the DiT model (#3661) 2025-05-09 08:06:54 +08:00
common feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
cpSplitPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cudaStreamPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
cumsumLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
doraPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eaglePlugin fix: Eagle decoding in TRT flow (#4229) 2025-05-14 16:10:49 +02:00
fp4GemmPlugin feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
fp8RowwiseGemmPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fusedLayernormPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gemmAllReducePlugin feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
gemmPlugin feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
gemmSwigluPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gptAttentionCommon fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
gptAttentionPlugin Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
identityPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
layernormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lookupPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
loraPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lowLatencyGemmPlugin feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
lowLatencyGemmSwigluPlugin feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
lruPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mambaConv1dPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mixtureOfExperts chore: Mass integration of release/0.20 (#4898) 2025-06-08 23:26:26 +08:00
ncclPlugin refactor: Introduce MpiTag enumeration and update MPI function signatures (#3893) 2025-05-04 13:24:29 +02:00
qserveGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
quantizePerTokenPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeTensorPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeToFP4Plugin update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
rmsnormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
selectiveScanPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
smoothQuantGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
topkLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
weightOnlyGroupwiseQuantMatmulPlugin chore: Mass integration of release/0.20. (#4871) 2025-06-04 14:12:27 +08:00
weightOnlyQuantMatmulPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
CMakeLists.txt feat: support add internal cutlass kernels as subproject (#3658) 2025-05-06 11:35:07 +08:00
exports.def Update 2023-10-10 23:22:17 -07:00
exports.map Update TensorRT-LLM (#1530) 2024-04-30 17:19:10 +08:00