TensorRT-LLMs/cpp/tensorrt_llm/pybind/executor
Aurelien Chartier 7b38018fa0
feat: Add numNodes to ParallelConfig (#3346)
* Add numNodes to ParallelConfig

If not provided, attempt to find the number of nodes by
adding the number of local ranks 0

Update device IDs check accordingly

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

* Add ParallelConfig pickle test

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>

---------

Signed-off-by: Aurelien Chartier <achartier@nvidia.com>
2025-04-13 13:55:04 +02:00
..
bindings.cpp feat: Add BW measurement (#3070) 2025-03-28 10:53:00 +08:00
bindings.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
executor.cpp Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
executor.h Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
executorConfig.cpp feat: Add numNodes to ParallelConfig (#3346) 2025-04-13 13:55:04 +02:00
executorConfig.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
request.cpp feat: Allow individual gatherContext for each additional output (#3374) 2025-04-12 17:00:36 +08:00
request.h Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
streamCaster.h Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
tensorCaster.h Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00