TensorRT-LLMs/requirements.txt
Kaiyu Xie bca9a33b02
Update TensorRT-LLM (#2008)
* Update TensorRT-LLM

---------

Co-authored-by: Timur Abishev <abishev.timur@gmail.com>
Co-authored-by: MahmoudAshraf97 <hassouna97.ma@gmail.com>
Co-authored-by: Saeyoon Oh <saeyoon.oh@furiosa.ai>
Co-authored-by: hattizai <hattizai@gmail.com>
2024-07-23 23:05:09 +08:00

32 lines
680 B
Plaintext

--extra-index-url https://pypi.nvidia.com
accelerate>=0.25.0
build
colored
cuda-python # Do not override the custom version of cuda-python installed in the NGC PyTorch image.
diffusers>=0.27.0
lark
mpi4py
numpy<2
onnx>=1.12.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py==3.10.0
StrEnum
sentencepiece>=0.1.99
# Allow tensorrt==10.2.0.post1
tensorrt~=10.2.0
# https://github.com/pytorch/pytorch/blob/v2.3.1/version.txt uses 2.3.0a0.
# https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-05.html#rel-24-05 uses 2.4.0a0.
torch>=2.3.0a0,<=2.4.0a0
nvidia-modelopt~=0.13,<0.14
transformers>=4.38.2
pillow==10.3.0
wheel
optimum
evaluate
janus
mpmath>=1.3.0