TensorRT-LLMs/cpp/tensorrt_llm/plugins
Yibin Li 32ae1564bd
update FP4 quantize layout (#3045)
Signed-off-by: Yibin Li <109242046+yibinl-nvidia@users.noreply.github.com>
2025-04-03 13:13:54 -04:00
..
api Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
bertAttentionPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
common Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
cpSplitPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cudaStreamPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
cumsumLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
doraPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
eaglePlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fp4GemmPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fp8RowwiseGemmPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
fusedLayernormPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gemmAllReducePlugin chore: cutlass cleanup (#3165) 2025-04-01 13:57:38 +08:00
gemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gemmSwigluPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
gptAttentionCommon fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
gptAttentionPlugin fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
identityPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
layernormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
lookupPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
loraPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lowLatencyGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lowLatencyGemmSwigluPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
lruPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mambaConv1dPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
mixtureOfExperts perf: Add optimizations for deepseek in min latency mode (#3093) 2025-04-02 09:05:24 +08:00
ncclPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
qserveGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
quantizePerTokenPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeTensorPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
quantizeToFP4Plugin update FP4 quantize layout (#3045) 2025-04-03 13:13:54 -04:00
rmsnormQuantizationPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
selectiveScanPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
smoothQuantGemmPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
topkLastDimPlugin Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
weightOnlyGroupwiseQuantMatmulPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
weightOnlyQuantMatmulPlugin Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
CMakeLists.txt Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
exports.def Update 2023-10-10 23:22:17 -07:00
exports.map Update TensorRT-LLM (#1530) 2024-04-30 17:19:10 +08:00