TensorRT-LLMs/cpp/tensorrt_llm
Enwei Zhu 4b299cb77e
feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408)
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-07-31 09:53:52 +08:00
..
batch_manager feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
common feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
cutlass_extensions/include/cutlass_extensions Fix GEMM+AR fusion on blackwell (#5563) 2025-07-09 08:48:47 +08:00
deep_ep DeepEP LL dispatch FP4 (#6296) 2025-07-28 11:25:42 +08:00
executor feat: Support structural tag in C++ runtime and upgrade xgrammar to 0.1.21 (#6408) 2025-07-31 09:53:52 +08:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels [TRTLLM-6445] feat: Enable AllReduce-associated fusion patterns in Llama3/4. (#6205) 2025-07-28 09:36:26 +08:00
layers refactor: Remove enforced sorted order of batch slots (#3502) 2025-07-14 17:23:02 +02:00
nanobind fix: integration tests with nanobind (#6326) 2025-07-25 09:23:20 +08:00
plugins fix TMA error with GEMM+AR on TP=2 (#6075) 2025-07-18 10:26:08 +08:00
pybind [nvbug/5374773] chore: Add a runtime flag to enable fail fast when attn window is too large to fit at least one sequence in KV cache (#5974) 2025-07-25 18:10:40 -04:00
runtime fix TMA error with GEMM+AR on TP=2 (#6075) 2025-07-18 10:26:08 +08:00
testing fix: Improve chunking test and skip empty kernel calls (#5710) 2025-07-04 09:08:15 +02:00
thop [https://nvbugs/5340941] - fix: Correct custom ops used by Qwen3 Moe … (#6285) 2025-07-25 14:49:45 +08:00
CMakeLists.txt feat: binding type build argument (pybind, nanobind) (#5802) 2025-07-11 00:48:50 +09:00