kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
d31fefde2c
TensorRT-LLMs/docs/source/installation/grace-hopper.md
Yanchao Lu 504f4bf779
[Infra] - Update the upstream PyTorch dependency to 2.7.0 (#4235) 
[Infra][TRTLLM-4941] - Update the upstream PyTorch dependency to 2.7.0

Signed-off-by: Yanchao Lu <yanchaol@nvidia.com>
2025-05-14 22:28:13 +08:00

773 B
Raw Blame History

(grace-hopper)=

Installing on Grace Hopper

  1. Install TensorRT-LLM (tested on Ubuntu 24.04).

    pip3 install torch==2.7.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128

sudo apt-get -y install libopenmpi-dev && pip3 install --upgrade pip setuptools && pip3 install tensorrt_llm

    If using the PyTorch NGC Container image, the prerequisite steps for installing CUDA-enabled PyTorch package and libopenmpi-dev are not required.

  2. Sanity check the installation by running the following in Python (tested on Python 3.12):

        :language: python
    :linenos: