TensorRT-LLMs/tensorrt_llm/bench/dataclasses
Frank f8a4cc0629
perf: Add total token throughput metric. (#3212)
Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com>
2025-04-05 13:17:59 +08:00
..
__init__.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
configuration.py perf: Readd iteration logging for trtllm-bench. (#3039) 2025-04-01 08:13:09 +08:00
engine.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
enums.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
general.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
reporting.py perf: Add total token throughput metric. (#3212) 2025-04-05 13:17:59 +08:00
statistics.py perf: Add total token throughput metric. (#3212) 2025-04-05 13:17:59 +08:00