mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-22 19:52:38 +08:00
13 lines
500 B
Markdown
13 lines
500 B
Markdown
(containers)=
|
|
|
|
# Pre-built release container images on NGC
|
|
|
|
Pre-built TensorRT-LLM releases are made available as container images
|
|
on NGC. This is likely the simplest way to obtain TensorRT-LLM. Please refer to the [documentation in NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tensorrt-llm/containers/release) for usage instructions.
|
|
|
|
{{container_tag_admonition}}
|
|
|
|
Containers can also be built locally, see
|
|
<https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker>
|
|
for all related options.
|