kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[None] [fix] Disable UCC as WAR to MPI allgather issue before NGC PyTorch 25.12 upgrade (#9127)

Browse Source 
Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
This commit is contained in:
Kaiyu Xie 2025-11-14 17:18:04 +08:00 committed by GitHub
parent d43036e3fd
commit e5c1cd41cd
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
tensorrt_llm/__init__.py
View File

@ -13,12 +13,16 @@
# See the License for the specific language governing permissions and # See the License for the specific language governing permissions and
# limitations under the License. # limitations under the License.
import os
# Disable UCC to WAR allgather issue before NGC PyTorch 25.12 upgrade.
os.environ["OMPI_MCA_coll_ucc_enable"] = "0"
def _add_trt_llm_dll_directory(): def _add_trt_llm_dll_directory():
import platform import platform
on_windows = platform.system() == "Windows" on_windows = platform.system() == "Windows"
if on_windows: if on_windows:
import os
import sysconfig import sysconfig
from pathlib import Path from pathlib import Path
os.add_dll_directory( os.add_dll_directory(