kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
7b38018fa0
TensorRT-LLMs/cpp/include/tensorrt_llm/runtime/utils
History
Aurelien Chartier 7b38018fa0
feat: Add numNodes to ParallelConfig (#3346) 
* Add numNodes to ParallelConfig

If not provided, attempt to find the number of nodes by
adding the number of local ranks 0

Update device IDs check accordingly

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

* Add ParallelConfig pickle test

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

---------

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>
2025-04-13 13:55:04 +02:00
..
debugUtils.h Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
mpiUtils.h feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00
multiDeviceUtils.h Update TensorRT-LLM (#1530) 2024-04-30 17:19:10 +08:00
speculativeChoicesUtils.h Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00