TensorRT-LLMs/requirements.txt
Kaiyu Xie 587d063e6d
Update TensorRT-LLM (#506)
* Update TensorRT-LLM

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2023-11-30 16:46:22 +08:00

16 lines
184 B
Plaintext

build
torch
transformers==4.33.1
diffusers==0.15.0
accelerate==0.20.3
colored
polygraphy
onnx>=1.12.0
mpi4py
tensorrt>=8.6.0
numpy
cuda-python==12.2.0
sentencepiece>=0.1.99
wheel
lark