TensorRT-LLMs/tensorrt_llm/auto_parallel/__init__.py
Kaiyu Xie 9bd15f1937
TensorRT-LLM v0.10 update
* TensorRT-LLM Release 0.10.0

---------

Co-authored-by: Loki <lokravi@amazon.com>
Co-authored-by: meghagarwal <16129366+megha95@users.noreply.github.com>
2024-06-05 20:43:25 +08:00

10 lines
217 B
Python

from .auto_parallel import auto_parallel
from .cluster_info import infer_cluster_config
from .config import AutoParallelConfig
__all__ = [
'auto_parallel',
'AutoParallelConfig',
'infer_cluster_config',
]