TensorRT-LLMs/requirements.txt
Dan Blanaru 48686bca3a
open source 7f370deb0090d885d7518c2b146399ba3933c004 (#2273)
* Update TensorRT-LLM

---------
Co-authored-by: Qingquan Song <ustcsqq@gmail.com>
2024-09-30 13:51:19 +02:00

34 lines
692 B
Plaintext

--extra-index-url https://pypi.nvidia.com
accelerate>=0.25.0
build
colored
cuda-python # Do not override the custom version of cuda-python installed in the NGC PyTorch image.
diffusers>=0.27.0
lark
mpi4py
numpy<2
onnx>=1.12.0
openai==1.39.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py==3.10.0
StrEnum
sentencepiece>=0.1.99
tensorrt~=10.4.0
# https://github.com/pytorch/pytorch/blob/v2.4.0/version.txt uses 2.4.0a0.
# https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-07.html#rel-24-07 uses 2.4.0a0.
torch>=2.4.0a0,<=2.4.0
nvidia-modelopt~=0.15.0
transformers>=4.38.2,<=4.42.4
pillow==10.3.0
wheel
optimum
evaluate
mpmath>=1.3.0
click
click_option_group
aenum