kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
cbca6505ff
TensorRT-LLMs/cpp/tensorrt_llm/pybind
History
pcastonguay 9643be5f20
[TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156) 
* feat: Add per-request stats support with PyT backend

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Adding unit test

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Fixing stats unit test

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Fixing test with overlap

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

---------

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>
2025-05-12 21:35:15 -04:00
..
batch_manager [TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156) 2025-05-12 21:35:15 -04:00
common fix: Move all casters to customCasters. (#3945) 2025-05-02 19:08:28 +08:00
executor Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
runtime fix: Move all casters to customCasters. (#3945) 2025-05-02 19:08:28 +08:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
userbuffers fix: Move all casters to customCasters. (#3945) 2025-05-02 19:08:28 +08:00
bindings.cpp refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
CMakeLists.txt refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00