pcastonguay 9643be5f20 [TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156) ... * feat: Add per-request stats support with PyT backend Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Adding unit test Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing stats unit test Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing test with overlap Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> --------- Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>		2025-05-12 21:35:15 -04:00
..
batch_manager	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
common	[fix] trtllm-gen mla kernel warnings (#4119)	2025-05-09 20:21:28 +08:00
cutlass_extensions/include/cutlass_extensions	TRTLLM-4624 feat: Add nvfp4 gemm and moe support for SM120 (#3770)	2025-04-29 11:19:11 -04:00
executor	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
executor_worker	Update TensorRT-LLM (#2792)	2025-02-18 21:27:39 +08:00
kernels	feat: Add heuristic for GroupRMSNorm kernel selection. (#4047)	2025-05-13 08:52:53 +08:00
layers	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
plugins	Support RingAttention in the BertAttention plugin and the DiT model (#3661)	2025-05-09 08:06:54 +08:00
pybind	[TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156)	2025-05-12 21:35:15 -04:00
runtime	Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979)	2025-05-12 22:32:29 +02:00
testing	refactor: Move ModelSpec to core library (#3980)	2025-05-04 01:39:09 +08:00
thop	feat: Add heuristic for GroupRMSNorm kernel selection. (#4047)	2025-05-13 08:52:53 +08:00
CMakeLists.txt	Cherry-pick trtllm-gen from feat/llama4 to main (#4086)	2025-05-08 14:13:01 -07:00