TensorRT-LLMs/requirements-windows.txt
Kaiyu Xie 8dd9c91470
Update TensorRT-LLM (#539)
* Update TensorRT-LLM

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2023-12-04 18:06:59 +08:00

24 lines
554 B
Plaintext

build
--extra-index-url https://download.pytorch.org/whl/cu121
# Default torch is CPU-only on Windows, so need to specify a torch version with GPU support
torch==2.1.0+cu121
torchvision==0.16.0+cu121
torchdata==0.7.0
torchtext==0.16.0+cpu
tokenizers==0.13.3
transformers==4.33.1
diffusers==0.15.0
accelerate==0.20.3
colored
polygraphy
onnx>=1.12.0
mpi4py
numpy
cuda-python==12.2.0
sentencepiece>=0.1.99
wheel
pywin32
--extra-index-url https://pypi.nvidia.com
tensorrt==9.2.0.post12.dev5
# lark is not needed on windows because plugin_gen is unsupported.