Yixin Dong c90ebadd84 feat: Support the Structural Tag in guided decoding (#4066) ... * finish Signed-off-by: Ubospica <ubospica@gmail.com> * update Signed-off-by: Ubospica <ubospica@gmail.com> * update Signed-off-by: Ubospica <ubospica@gmail.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * exc overlap scheduler Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * add test Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix api ref Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> --------- Signed-off-by: Ubospica <ubospica@gmail.com> Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> Co-authored-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>		2025-05-12 17:24:50 +08:00
..
batch_manager	fix cache buffer (#3942)	2025-05-07 09:49:44 +08:00
common	[fix] trtllm-gen mla kernel warnings (#4119)	2025-05-09 20:21:28 +08:00
cutlass_extensions/include/cutlass_extensions	TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770)	2025-04-29 11:19:11 -04:00
executor	chore: Cleanup deprecated APIs from LLM-API (part 1/2) (#3732)	2025-05-07 13:20:25 +08:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	Feat: support exporting softmax statistics and update the kernel-selection heuristic (#4155)	2025-05-12 15:31:46 +08:00
layers	fix: Eagle decoding (#3456)	2025-04-11 22:06:38 +08:00
plugins	Support RingAttention in the BertAttention plugin and the DiT model (#3661)	2025-05-09 08:06:54 +08:00
pybind	feat: Support the Structural Tag in guided decoding (#4066)	2025-05-12 17:24:50 +08:00
runtime	[TRTLLM-3429] feat: Overlap scheduling in C++ runtime (#3625)	2025-05-06 15:06:46 +02:00
testing	refactor: Move ModelSpec to core library (#3980)	2025-05-04 01:39:09 +08:00
thop	[TRTLLM-3105][feat] Add Piecewise CUDA Graph Support (#3804)	2025-05-09 11:04:01 +08:00
CMakeLists.txt	Cherry-pick trtllm-gen from feat/llama4 to main (#4086)	2025-05-08 14:13:01 -07:00