kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
c045e359a7
TensorRT-LLMs/tensorrt_llm/executor
History
Pengyun Lin eca68e4465 [https://nvbugs/5564465][fix] Overwrite only if default_max_tokens is legal (#8538) 
Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
Signed-off-by: Mike Iovine <miovine@nvidia.com>
2025-11-20 12:43:13 -05:00
..
rpc [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
base_worker.py [https://nvbugs/5564465][fix] Overwrite only if default_max_tokens is legal (#8538) 2025-11-20 12:43:13 -05:00
executor.py [None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api (#8415) 2025-11-03 17:59:49 -08:00
ipc.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
postproc_worker.py [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
proxy.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
ray_executor.py [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
ray_gpu_worker.py [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
request.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
result.py [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
rpc_proxy.py [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
rpc_worker.py [TRTLLM-8988][feat] Unify MPI & Ray's req/response handling with RPC Client/Server (#8765) 2025-11-13 17:21:24 -08:00
utils.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
worker.py [https://nvbugs/5556998][fix] init_hf_modules in worker_main for models with trust_remote=true (#8931) 2025-11-11 10:30:37 +08:00