kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[https://nvbugs/5519544][fix] fix invalid expression for disabling pa… (#7806)

Browse Source 
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
This commit is contained in:
Guoming Zhang 2025-09-18 12:54:52 +08:00 committed by GitHub
parent f8e811d134
commit e0423bfaab
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tensorrt_llm/_torch/models/modeling_utils.py
View File

@ -895,7 +895,7 @@ def _load_weights_impl(model: Union[nn.Module, DecoderModelForCausalLM],
p.data.copy_(module_weights[n][:])
if os.environ.get("TRT_LLM_DISABLE_LOAD_WEIGHTS_IN_PARALLEL",
False) in ["True", "true", "1", "yes", "y"]:
"True") in ["True", "true", "1", "yes", "y"]:
for name, module in tqdm(list(model.named_modules()),
desc="Loading weights"):
load_single_module(name, module)