TensorRT-LLMs/cpp/tensorrt_llm
jellysnack 0623ffe3bc
feat: Add LLGuidance Support for PyTorch Backend (#5214)
Signed-off-by: jellysnack <oleg.jellysnack@gmail.com>
Signed-off-by: jellysnack <158609015+jellysnack@users.noreply.github.com>
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
Co-authored-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-06-18 19:33:34 +08:00
..
batch_manager refactor: Update decoder buffer and logits management (#4450) 2025-06-18 08:10:32 +08:00
common use file lock to avoid port conflict (#5123) 2025-06-16 14:15:37 +08:00
cutlass_extensions/include/cutlass_extensions refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00
executor chore: Mass integration of release/0.20 (#5082) 2025-06-17 14:32:02 +03:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels delete cubins (#5274) 2025-06-17 22:10:49 +08:00
layers Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
plugins [TRTLLM-5330] perf: Optimize MoE supplementary kernels for large-scale EP (#5215) 2025-06-17 15:23:24 +08:00
pybind feat: Add LLGuidance Support for PyTorch Backend (#5214) 2025-06-18 19:33:34 +08:00
runtime refactor: remove decoder request from decoder interface (#5129) 2025-06-16 09:12:30 +02:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
thop chore: Refine printed info of CHECK_TYPE. (#5295) 2025-06-18 15:35:41 +08:00
CMakeLists.txt refactoring: port customized kernels with public cutlass version (#5027) 2025-06-13 16:19:31 +08:00