Thor Johnsen 5d438be59a [TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936) ... * v1.5 Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> v1.5.4 Add back draft_overhead to spec dec stats Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> * v1.5.5: fix CI error Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> * v1.6: fix CI error 8196 > 8192 Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> * Address reviewer concerns Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> * Address reviewer concerns Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> * precommit run Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> * v2.0: Address reviewer concerns Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> * v2.1: add fix from wili Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> * Revert changes that require use of TypeAlias because that requires python version >= 3.10 Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> --------- Signed-off-by: Thor Johnsen <41591019+thorjohnsen@users.noreply.github.com> Signed-off-by: wili-65535 <wili-65535@users.noreply.github.com> Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>		2025-05-21 10:40:00 +08:00
..
bindings.cpp	[TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936)	2025-05-21 10:40:00 +08:00
bindings.h	fix: Move all casters to customCasters. (#3945)	2025-05-02 19:08:28 +08:00
executor.cpp	Update TensorRT-LLM (#2436)	2024-11-12 15:27:49 +08:00
executor.h	Update TensorRT-LLM (#2562)	2024-12-11 00:31:05 -08:00
executorConfig.cpp	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
executorConfig.h	fix: Move all casters to customCasters. (#3945)	2025-05-02 19:08:28 +08:00
request.cpp	feat: Support the Structural Tag in guided decoding (#4066)	2025-05-12 17:24:50 +08:00
request.h	fix: Move all casters to customCasters. (#3945)	2025-05-02 19:08:28 +08:00