mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
* Update gen tps calculation. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Add back output speed for comparison. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Fix issue with f-string. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Fix some spacing. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Replace output speed with per-request genphase tput. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Add gen TPS breakdown. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> * Update some tagging. Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> --------- Signed-off-by: Frank Di Natale <3429989+FrankD412@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| benchmark | ||
| build | ||
| dataclasses | ||
| utils | ||
| __init__.py | ||