TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

wili 34e63d07e6 feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 ) * feat: Variable-Beam-Width-Search Part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part2, fix CPP tests Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part3, simplify CPP tests Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part4, move beam_width_array param Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search, fix CI error Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2, fix pre-commit Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2, fix review Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> --------- Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> Co-authored-by: wili-65535 <wili-65535@user.noreply.github.com>		2025-04-02 12:31:28 +08:00
..
banWordsLayer.cpp	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
banWordsLayer.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
baseLayer.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
beamSearchLayer.cu	feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 )	2025-04-02 12:31:28 +08:00
beamSearchLayer.h	feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 )	2025-04-02 12:31:28 +08:00
CMakeLists.txt	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
decodingLayer.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
decodingLayer.h	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (#2297 )	2024-10-08 12:19:19 +02:00
decodingParams.h	feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 )	2025-04-02 12:31:28 +08:00
dynamicDecodeLayer.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
dynamicDecodeLayer.h	Update TensorRT-LLM (#2582 )	2024-12-16 21:50:47 -08:00
eagleDecodingLayer.cpp	Update TensorRT-LLM (#2562 )	2024-12-11 00:31:05 -08:00
eagleDecodingLayer.h	Update TensorRT-LLM (#2502 )	2024-11-26 16:51:34 +08:00
explicitDraftTokensLayer.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
explicitDraftTokensLayer.h	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
externalDraftTokensLayer.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
externalDraftTokensLayer.h	Update TensorRT-LLM (#2755 )	2025-02-11 03:01:00 +00:00
layersFactory.h	Update TensorRT-LLM (#2436 )	2024-11-12 15:27:49 +08:00
layerUtils.h	v1.2 (#3082 )	2025-03-26 23:31:29 +08:00
lookaheadAlgorithm.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
lookaheadAlgorithm.h	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
lookaheadDecodingLayer.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
lookaheadDecodingLayer.h	Update TensorRT-LLM (#2333 )	2024-10-15 15:28:40 +08:00
lookaheadDecodingUtils.h	Update TensorRT-LLM (#2253 )	2024-09-24 17:27:31 +02:00
lookaheadPoolManager.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
lookaheadPoolManager.h	Update TensorRT-LLM (#1763 )	2024-06-11 16:59:02 +08:00
medusaDecodingLayer.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
medusaDecodingLayer.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
penaltyLayer.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
penaltyLayer.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
samplingLayer.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
samplingLayer.h	Update TensorRT-LLM (#2755 )	2025-02-11 03:01:00 +00:00
stopCriteriaLayer.cpp	Update TensorRT-LLM (#2849 )	2025-03-04 18:44:00 +08:00
stopCriteriaLayer.h	Update TensorRT-LLM (#2184 )	2024-09-03 12:14:23 +02:00
topKSamplingLayer.cpp	Update TensorRT-LLM (#2562 )	2024-12-11 00:31:05 -08:00
topKSamplingLayer.h	Update TensorRT-LLM (#2413 )	2024-11-05 16:27:06 +08:00
topPSamplingLayer.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
topPSamplingLayer.h	Update TensorRT-LLM (#2460 )	2024-11-19 18:30:34 +08:00