TensorRT-LLMs/tensorrt_llm/executor
Yan Chunwei bc4136ffe7
[https://nvbugs/5427043][fix] cherrypick: request length exceeds max_num_tokens (#7718)
Signed-off-by: Superjomn <328693+Superjomn@users.noreply.github.com>
2025-09-22 03:37:48 -07:00
..
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
executor.py [None][feat] Add support of scheduling attention dp request (#6246) 2025-08-01 20:38:01 -04:00
ipc.py [https://nvbugs/5451296][fix] zmq nonblock bug with retry (#7019) 2025-08-21 08:34:46 +08:00
postproc_worker.py feat: Support post_proc for bench (#5122) 2025-06-15 13:02:38 +08:00
proxy.py [https://nvbugs/5451296][fix] zmq nonblock bug with retry (#7019) 2025-08-21 08:34:46 +08:00
request.py [None][feat] Add support of scheduling attention dp request (#6246) 2025-08-01 20:38:01 -04:00
result.py [fix] Add detokenization-based stop word logic to LLM API (#5948) 2025-07-29 10:16:59 -07:00
utils.py fix[nvbug5298640]: trtllm-llmapi-launch multiple LLM instances (#4727) 2025-06-19 06:13:53 +08:00
worker.py [https://nvbugs/5427043][fix] cherrypick: request length exceeds max_num_tokens (#7718) 2025-09-22 03:37:48 -07:00