TensorRT-LLMs/cpp/tensorrt_llm/pybind
wili 54ad95eaa8
Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338)
* feat/Variable-Beam-Width-Search-Part3, v1.0

Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com>

* feat/Variable-Beam-Width-Search-Part3, v1.1

Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com>

* feat/Variable-Beam-Width-Search-Part3, v1.2

Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com>

---------

Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com>
Co-authored-by: wili-65535 <wili-65535@user.noreply.github.com>
2025-04-08 23:51:27 +08:00
..
batch_manager Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
common feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
executor Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
runtime feat: fix and improve allreduce and fusion kernels (#3064) 2025-04-08 19:33:52 +08:00
userbuffers feat: Introduce UB allocator for pytorch flow (#3257) 2025-04-08 18:39:49 +08:00
bindings.cpp feat: Support PeftCacheManager in Torch (#3186) 2025-04-04 12:38:08 +08:00
CMakeLists.txt Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00