mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com> Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
24 lines
685 B
ReStructuredText
24 lines
685 B
ReStructuredText
.. _installation:
|
|
|
|
Installation
|
|
============
|
|
|
|
There are multiple ways to install and run TensorRT-LLM. For most users, the options below should be ordered from simple to complex. The approaches are equivalent in terms of the supported features.
|
|
|
|
Note: **This project will download and install additional third-party open source software projects. Review the license terms of these open source projects before use.**
|
|
|
|
1. :ref:`containers`
|
|
|
|
2. Pre-built release wheels on `PyPI <https://pypi.org/project/tensorrt-llm>`_ (see :ref:`linux`)
|
|
|
|
3. :ref:`build-from-source-linux`
|
|
|
|
.. toctree::
|
|
:maxdepth: 1
|
|
:caption: Links
|
|
:hidden:
|
|
|
|
containers
|
|
linux
|
|
build-from-source-linux
|