TensorRT-LLMs/tests/unittest/bindings
Aurelien Chartier 7b38018fa0
feat: Add numNodes to ParallelConfig (#3346)
* Add numNodes to ParallelConfig

If not provided, attempt to find the number of nodes by
adding the number of local ranks 0

Update device IDs check accordingly

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

* Add ParallelConfig pickle test

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

---------

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>
2025-04-13 13:55:04 +02:00
..
binding_test_utils.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_bindings_ut.py feat: Allow individual gatherContext for each additional output (#3374) 2025-04-12 17:00:36 +08:00
test_executor_bindings.py feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00