mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
* fix bug of create cuda stream as default parameter which will be initialized during importing Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com> * add torch.cuda.Stream() for the leader node Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com> * fix pre-commit issue Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com> --------- Signed-off-by: bhsueh <11360707+byshiue@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| executor.py | ||
| ipc.py | ||
| postproc_worker.py | ||
| proxy.py | ||
| request.py | ||
| result.py | ||
| utils.py | ||
| worker.py | ||