kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-22 19:52:38 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
f9187b2fda
TensorRT-LLMs/tensorrt_llm/bench/dataclasses
History
Jiagan Cheng 85b4ae26b7
[https://nvbugs/5451342][fix] Use runtime max_batch_size when cuda_graph_config.max_batch_size is not provided in trtllm-bench (#7031) 
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
2025-08-26 08:10:35 -04:00
..
__init__.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
configuration.py [https://nvbugs/5451342][fix] Use runtime max_batch_size when cuda_graph_config.max_batch_size is not provided in trtllm-bench (#7031) 2025-08-26 08:10:35 -04:00
engine.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
enums.py Update TensorRT-LLM (#2502) 2024-11-26 16:51:34 +08:00
general.py Enable trtllm-bench to run LoRA and add basic e2e perf testing capability for LoRA in PyT flow (#5130) 2025-06-15 18:54:04 +03:00
reporting.py [TRTLLM-6685][feat] Add speculative metrics for trt llm bench (#6476) 2025-08-04 15:22:57 -07:00
statistics.py [TRTLLM-6685][feat] Add speculative metrics for trt llm bench (#6476) 2025-08-04 15:22:57 -07:00