kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
c0c3c7f68c
TensorRT-LLMs/tensorrt_llm/bench
History
Frank c0c3c7f68c
[TRTLLM-5233][feat]: Add chunking to PyT heuristic for trtllm-bench. (#4133) 
* Add chunking to PyT heuristic.

Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com>

* Cast tokens and batch size to ints.

Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com>

---------

Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com>
2025-05-13 21:47:06 +08:00
..
benchmark [TRTLLM-5233][feat]: Add chunking to PyT heuristic for trtllm-bench. (#4133) 2025-05-13 21:47:06 +08:00
build feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
dataclasses Fix incorrect conversion. (#4112) 2025-05-09 06:34:52 +08:00
utils feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
__init__.py Update TensorRT-LLM 2024-08-20 18:55:15 +08:00