TensorRT-LLMs/requirements.txt
2023-12-01 22:27:51 +08:00

18 lines
201 B
Plaintext

accelerate==0.20.3
build
colored
cuda-python==12.2.0
diffusers==0.15.0
lark
mpi4py
numpy
onnx>=1.12.0
polygraphy
sentencepiece>=0.1.99
tensorrt>=8.6.0
torch
transformers==4.33.1
wheel
optimum
evaluate