TensorRT-LLMs/requirements.txt
石晓伟 2a115dae84
Update TensorRT-LLM (#1793)
Co-authored-by: DreamGenX <x@dreamgen.com>
Co-authored-by: Ace-RR <78812427+Ace-RR@users.noreply.github.com>
Co-authored-by: bprus <39293131+bprus@users.noreply.github.com>
Co-authored-by: janpetrov <janpetrov@icloud.com>
2024-06-18 18:18:23 +08:00

30 lines
631 B
Plaintext

--extra-index-url https://pypi.nvidia.com
accelerate>=0.25.0
build
colored
cuda-python # Do not override the custom version of cuda-python installed in the NGC PyTorch image.
diffusers>=0.27.0
lark
mpi4py
numpy<2
onnx>=1.12.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py==3.10.0
StrEnum
sentencepiece>=0.1.99
tensorrt==10.0.1
# https://github.com/pytorch/pytorch/blob/v2.3.0/version.txt uses 2.3.0a0.
# https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-04.html#rel-24-04 uses 2.3.0a0.
torch>=2.3.0a,<=2.3.0
nvidia-modelopt~=0.11,<0.12
transformers>=4.38.2
wheel
optimum
evaluate
janus
mpmath>=1.3.0