TensorRT-LLMs/tensorrt_llm/executor
shuyixiong 70e4d72ffa
[TRTLLM-8511][feat] Add update_weights and sleep_wakeup support for rl integration (#8302)
Signed-off-by: shuyix <219646547+shuyixiong@users.noreply.github.com>
Co-authored-by: Liwei Ma <liweim@nvidia.com>
Co-authored-by: Jonas Yang CN <joyang@nvidia.com>
2025-11-04 10:19:24 -08:00
..
rpc [None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api (#8415) 2025-11-03 17:59:49 -08:00
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
base_worker.py [TRTLLM-8836][chore] Create ModelEngine from LlmArgs (#8600) 2025-11-01 05:26:06 -07:00
executor.py [None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api (#8415) 2025-11-03 17:59:49 -08:00
ipc.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
postproc_worker.py [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
proxy.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
ray_executor.py [None][fix] Change Ray submit() to use async RPC (#8636) 2025-10-28 00:56:13 -04:00
ray_gpu_worker.py [TRTLLM-8511][feat] Add update_weights and sleep_wakeup support for rl integration (#8302) 2025-11-04 10:19:24 -08:00
request.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
result.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
rpc_proxy.py [None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api (#8415) 2025-11-03 17:59:49 -08:00
rpc_worker.py [None][chore] Optimize perf for the RPC executor and add some profile utilities to llm-api (#8415) 2025-11-03 17:59:49 -08:00
utils.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
worker.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00