TensorRT-LLMs/examples/quantization/requirements.txt
2024-12-24 15:58:43 +08:00

8 lines
152 B
Plaintext

tensorrt_llm==0.16.0
datasets>=2.14.4
nemo-toolkit[all]<=1.20.0,>=1.18.0
rouge_score~=0.1.2
transformers_stream_generator==0.0.4
tiktoken
mpmath==1.3.0