mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-16 15:55:08 +08:00
11 lines
485 B
Plaintext
11 lines
485 B
Plaintext
# Pre-built release container images on NGC
|
|
|
|
Pre-built TensorRT-LLM releases are made available as container images
|
|
on NGC. This is likely the simplest way to obtain TensorRT-LLM. Please refer to the [documentation in NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tensorrt-llm/containers/release) for usage instructions.
|
|
|
|
{{container_tag_admonition}}
|
|
|
|
Containers can also be built locally, see
|
|
<https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker>
|
|
for all related options.
|