TensorRT-LLMs/tests/model_api/llm_data.py
Kaiyu Xie d879430b04
Update TensorRT-LLM (#846)
* Update TensorRT-LLM

---------

Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>
2024-01-09 21:03:35 +08:00

12 lines
341 B
Python

import os
from pathlib import Path
def llm_models_root() -> str:
root = Path(
os.environ.get('LLM_MODELS_ROOT',
'/home/scratch.trt_llm_data/llm-models/'))
assert root.exists(), \
"You shall set LLM_MODELS_ROOT env or be able to access /home/scratch.trt_llm_data to run this test"
return root