kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-10 21:13:34 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
0cebc16139
TensorRT-LLMs/tests/unittest
History
pcastonguay 9643be5f20
[TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156) 
* feat: Add per-request stats support with PyT backend

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Adding unit test

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Fixing stats unit test

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

* Fixing test with overlap

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>

---------

Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com>
2025-05-12 21:35:15 -04:00
..
_torch feat: Add heuristic for GroupRMSNorm kernel selection. (#4047) 2025-05-13 08:52:53 +08:00
api_stability feat: Support the Structural Tag in guided decoding (#4066) 2025-05-12 17:24:50 +08:00
bindings Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
disaggregated feat: add kv cache aware router (#3831) 2025-05-12 07:23:57 -04:00
llmapi [TRTLLM-5050][feat] Enable per-request stats with PyT backend (#4156) 2025-05-12 21:35:15 -04:00
others test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
scaffolding [TRTLLM-4911] feat(scaffolding): make sampling_params only setable by controller (#4151) 2025-05-12 15:29:09 +08:00
tools Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
trt Unify two versions of AllReduce custom op (#3032) 2025-04-22 21:58:42 +08:00
utils refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
conftest.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
dump_checkpoint_stats.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
profile_utils.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
pytest.ini move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_model_runner_cpp.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_pip_install.py relax the limitation of setuptools (#2992) 2025-03-24 13:36:10 +08:00