TensorRT-LLMs/tensorrt_llm/executor
Robin Kobus db8c63b9b1
[TRTLLM-4517] [feat] Additional model outputs (#7206)
Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>
2025-10-13 15:33:18 +02:00
..
rpc [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
base_worker.py [https://nvbugs/5510879][fix] Fix pytorch & TRT-python flows fused LoRA adapter modules weight split with TP>1 (#8063) 2025-10-12 12:29:52 -07:00
executor.py [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00
ipc.py [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00
postproc_worker.py [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
proxy.py [None][fix] Fix EventLoopShutdownError (#8260) 2025-10-13 17:31:33 +08:00
ray_executor.py [TRTLLM-7349][feat] Adding new orchestrator type -- ray (#7520) 2025-10-04 08:12:24 +08:00
ray_gpu_worker.py [TRTLLM-7349][feat] Adding new orchestrator type -- ray (#7520) 2025-10-04 08:12:24 +08:00
request.py [None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553) 2025-09-15 07:26:01 -04:00
result.py [TRTLLM-4517] [feat] Additional model outputs (#7206) 2025-10-13 15:33:18 +02:00
rpc_proxy.py [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00
rpc_worker.py [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00
utils.py [#7692][fix] recognize RequestError as per-request error in background handler (#7726) 2025-09-24 11:11:17 +08:00
worker.py [TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543) 2025-10-05 17:28:20 +08:00