kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

fix: Fix missing key (#6471)

Browse Source 
Signed-off-by: Zero Zeng <38289304+zerollzeng@users.noreply.github.com>
This commit is contained in:
Zero Zeng 2025-08-01 14:25:58 +08:00 committed by GitHub
parent aee35e2dbd
commit 48768fd720
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
tensorrt_llm/serve/scripts/benchmark_serving.py
View File

@ -475,6 +475,7 @@ async def benchmark(
"user_throughput": metrics.tput_user,
"mean_request_ar": metrics.mean_request_ar,
"median_request_ar": metrics.median_request_ar,
"std_request_ar": metrics.std_request_ar,
"input_lens": [output.prompt_len for output in outputs],
"output_lens": actual_output_lens,
"ttfts": [output.ttft for output in outputs],