mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-13 22:18:36 +08:00
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com> Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
500 B
500 B
(containers)=
Pre-built release container images on NGC
Pre-built TensorRT LLM releases are made available as container images on NGC. This is likely the simplest way to obtain TensorRT LLM. Please refer to the documentation in NGC for usage instructions.
{{container_tag_admonition}}
Containers can also be built locally, see https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker for all related options.