mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com> Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
13 lines
500 B
Markdown
13 lines
500 B
Markdown
(containers)=
|
|
|
|
# Pre-built release container images on NGC
|
|
|
|
Pre-built TensorRT LLM releases are made available as container images
|
|
on NGC. This is likely the simplest way to obtain TensorRT LLM. Please refer to the [documentation in NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tensorrt-llm/containers/release) for usage instructions.
|
|
|
|
{{container_tag_admonition}}
|
|
|
|
Containers can also be built locally, see
|
|
<https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker>
|
|
for all related options.
|