kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[https://nvbugs/5652552][fix] cherry-pick add printing for llm args (#9206)

Browse Source 
Signed-off-by: Ruodi Lu <ruodil@users.noreply.github.com>
Co-authored-by: Ruodi Lu <ruodil@users.noreply.github.com>
This commit is contained in:
ruodil 2025-12-03 16:49:06 +08:00 committed by GitHub
parent ac5aa63b11
commit 0a6fd1de1b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
tensorrt_llm/_torch/pyexecutor/py_executor_creator.py
View File

@ -686,7 +686,8 @@ def create_py_executor(
_adjust_torch_mem_fraction(pytorch_backend_config) _adjust_torch_mem_fraction(pytorch_backend_config)
logger.info(f"{llm_args}") if mapping.rank == 0:
logger.info(f"LLM Args:\n{llm_args}")
py_executor.start_worker() py_executor.start_worker()
return py_executor return py_executor