TensorRT-LLMs/requirements-windows.txt
Kaiyu Xie f430a4b447
Update TensorRT-LLM (#1688)
* Update TensorRT-LLM

---------

Co-authored-by: IbrahimAmin <ibrahimamin532@gmail.com>
Co-authored-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: Pzzzzz <hello-cd.plus@hotmail.com>
Co-authored-by: CoderHam <hemant@cohere.com>
Co-authored-by: Konstantin Lopuhin <kostia.lopuhin@gmail.com>
2024-05-28 20:07:49 +08:00

29 lines
613 B
Plaintext

--extra-index-url https://pypi.nvidia.com
accelerate==0.25.0
build
colored
cuda-python==12.4.0
diffusers==0.27.0
numpy<2
onnx>=1.12.0
polygraphy
psutil
pynvml>=11.5.0
pulp
pandas
h5py==3.10.0
pywin32
StrEnum
sentencepiece>=0.1.99
tensorrt==10.0.1
tokenizers>=0.14
# Default torch is CPU-only on Windows, so need to specify a torch version with GPU support
torch @ https://download.pytorch.org/whl/cu121/torch-2.2.0%2Bcu121-cp310-cp310-win_amd64.whl#sha256=8f54c647ee19c8b4c0aad158c73b83b2c06cb62351e9cfa981540ce7295a9015
nvidia-modelopt~=0.11,<0.12
transformers==4.38.2
wheel
optimum
evaluate
janus
mpmath==1.3.0