mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-30 15:43:19 +08:00
28 lines
1.3 KiB
Markdown
28 lines
1.3 KiB
Markdown
# How use this folder
|
|
|
|
## Overview
|
|
|
|
This folder is designed to retrieve Mako information for the current node. To execute the script, run the following command:
|
|
|
|
```bash
|
|
python get_sysinfo.py --test-prefix ${stageName} --mako-opt stage=post_merge
|
|
```
|
|
|
|
## Functionality
|
|
|
|
The script generates information about the following system properties:
|
|
- **Operating System**: Includes OS version, OS code name, hostname, and memory.
|
|
- **CPU**: Provides details about the CPU and system name.
|
|
- **GPU**: Includes GPU count, compute capability, GPU type, chip model, GPU memory, CUDA version, cuBLAS version, and more.
|
|
- **Other Properties**: Includes support for FP8/int8/tf32 and indicates whether the system is Android.
|
|
All the information got will output to console
|
|
|
|
## Command Line Arguments
|
|
|
|
- `--mako-opt`: This argument allows you to add Mako options. Currently, stage=post_merge is used in the test database to differentiate between cases run during merge requests and those run post-merge.
|
|
Please note that more arguments may be added as needed.
|
|
|
|
## Notes
|
|
|
|
In addition to compute capability and chip details, we utilize the `nvidia-ml-py` package to gather most information. We use `cuda-python` to retrieve compute capability, and we read from a gpu_chip_mapping.json file, which comes from an internal package called `nrsu`, to obtain chip properties.
|