kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
4d711be8f4
TensorRT-LLMs/cpp/tensorrt_llm/layers
History
wili eba3623a54
Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 
* feat/vbws-part4-v1.8: rebase

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* feat/vbws-part4-v1.9: fix incorrect output when using short output length

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* v1.9.1: remove useless variables

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* v1.9.2:fix incorrect output when using short output length

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* v1.9.3: rebase

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* v1.9.4: rebase

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

* v1.9.5: remove API change

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>

---------

Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com>
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
2025-05-12 22:32:29 +02:00
..
banWordsLayer.cpp chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
banWordsLayer.h Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
baseLayer.h Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
beamSearchLayer.cu Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
beamSearchLayer.h Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
CMakeLists.txt Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
decodingLayer.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
decodingLayer.h open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (#2297) 2024-10-08 12:19:19 +02:00
decodingParams.h Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
dynamicDecodeLayer.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
dynamicDecodeLayer.h Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
eagleDecodingLayer.cpp fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
eagleDecodingLayer.h Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
explicitDraftTokensLayer.cpp fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
explicitDraftTokensLayer.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
externalDraftTokensLayer.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
externalDraftTokensLayer.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
layersFactory.h Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
layerUtils.h v1.2 (#3082) 2025-03-26 23:31:29 +08:00
lookaheadAlgorithm.cpp Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
lookaheadAlgorithm.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
lookaheadDecodingLayer.cpp Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
lookaheadDecodingLayer.h Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
lookaheadDecodingUtils.h Update TensorRT-LLM (#2253) 2024-09-24 17:27:31 +02:00
lookaheadPoolManager.cpp Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
lookaheadPoolManager.h Update TensorRT-LLM (#1763) 2024-06-11 16:59:02 +08:00
medusaDecodingLayer.cpp fix: Eagle decoding (#3456) 2025-04-11 22:06:38 +08:00
medusaDecodingLayer.h Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
penaltyLayer.cpp chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
penaltyLayer.h Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
samplingLayer.cpp chore: remove usernames from comments (#3291) 2025-04-05 13:44:28 +08:00
samplingLayer.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
stopCriteriaLayer.cpp Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
stopCriteriaLayer.h Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
topKSamplingLayer.cpp Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
topKSamplingLayer.h Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
topPSamplingLayer.cpp Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
topPSamplingLayer.h Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00