kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
258ae9c58c
TensorRT-LLMs/cpp/tensorrt_llm/plugins
History
Pamela Peng 6cdfc54883
feat: Add FP8 support for SM 120 (#3248) 
* Allow FP8 on SM120

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix sm121

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* fix pre-commit

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

* review update

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>

---------

Signed-off-by: Pamela Peng <179191831+pamelap-nvidia@users.noreply.github.com>
Co-authored-by: Sharan Chetlur <116769508+schetlur-nv@users.noreply.github.com>
2025-04-14 16:05:41 -07:00
..
api Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
bertAttentionPlugin Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
common Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
cpSplitPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cudaStreamPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
cumsumLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
doraPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eaglePlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fp4GemmPlugin feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
fp8RowwiseGemmPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fusedLayernormPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gemmAllReducePlugin chore: cutlass cleanup (#3165) 2025-04-01 13:57:38 +08:00
gemmPlugin feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
gemmSwigluPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gptAttentionCommon fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
gptAttentionPlugin Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
identityPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
layernormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lookupPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
loraPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lowLatencyGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lowLatencyGemmSwigluPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lruPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mambaConv1dPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mixtureOfExperts feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
ncclPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
qserveGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
quantizePerTokenPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeTensorPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeToFP4Plugin update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
rmsnormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
selectiveScanPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
smoothQuantGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
topkLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
weightOnlyGroupwiseQuantMatmulPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
weightOnlyQuantMatmulPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
CMakeLists.txt Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
exports.def Update 2023-10-10 23:22:17 -07:00
exports.map Update TensorRT-LLM (#1530) 2024-04-30 17:19:10 +08:00