TensorRT-LLMs/requirements.txt
Kaiyu Xie be9cd719f7
Update TensorRT-LLM (#2094)
* Update TensorRT-LLM

---------

Co-authored-by: akhoroshev <arthoroshev@gmail.com>
Co-authored-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: Tayef Shah <tayefshah@gmail.com>
Co-authored-by: lfz941 <linfanzai941@gmail.com>
2024-08-07 16:44:43 +08:00

32 lines
685 B
Plaintext

--extra-index-url https://pypi.nvidia.com
accelerate>=0.25.0
build
colored
cuda-python # Do not override the custom version of cuda-python installed in the NGC PyTorch image.
diffusers>=0.27.0
lark
mpi4py
numpy<2
onnx>=1.12.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py==3.10.0
StrEnum
sentencepiece>=0.1.99
# Allow tensorrt==10.2.0.post1
tensorrt~=10.2.0
# https://github.com/pytorch/pytorch/blob/v2.3.1/version.txt uses 2.3.0a0.
# https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-05.html#rel-24-05 uses 2.4.0a0.
torch>=2.3.0a0,<=2.4.0a0
nvidia-modelopt~=0.15.0
transformers>=4.38.2,<=4.42.4
pillow==10.3.0
wheel
optimum
evaluate
janus
mpmath>=1.3.0