TensorRT-LLMs/tensorrt_llm/executor
gramnarayan 88b0fbc8ff
[#8245][feat] Autodeploy: Guided Decoding Support (#8551)
Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
Signed-off-by: Govind Ramnarayan <105831528+govind-ramnarayan@users.noreply.github.com>
Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
Co-authored-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
Co-authored-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
2025-10-28 09:29:57 +08:00
..
rpc [None][fix] fix rpc unique addr related issue (#8419) 2025-10-22 04:47:18 -04:00
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
base_worker.py [#8245][feat] Autodeploy: Guided Decoding Support (#8551) 2025-10-28 09:29:57 +08:00
executor.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
ipc.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
postproc_worker.py [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
proxy.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
ray_executor.py [TRTLLM-8480][chore] clean create_py_executor API (#8412) 2025-10-17 23:52:02 -04:00
ray_gpu_worker.py [TRTLLM-8513][feat] Add back worker extension (#8482) 2025-10-24 20:30:28 -04:00
request.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
result.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
rpc_proxy.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
rpc_worker.py [TRTLLM-8480][chore] clean create_py_executor API (#8412) 2025-10-17 23:52:02 -04:00
utils.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00
worker.py [None][chore] replace print_colored_debug with logger_debug (#8417) 2025-10-22 17:54:38 +08:00