TensorRT-LLMs/tensorrt_llm/executor
Shunkangz dda7354d1a
Refactor return of first gen token in PD (#2986)
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
2025-04-01 12:28:27 +08:00
..
__init__.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executor.py Update (#2978) 2025-03-23 16:39:35 +08:00
ipc.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
postproc_worker.py Fix: fuse message not aligned on different processes (#3067) 2025-03-26 17:15:27 +08:00
proxy.py perf: Readd iteration logging for trtllm-bench. (#3039) 2025-04-01 08:13:09 +08:00
request.py Update (#2978) 2025-03-23 16:39:35 +08:00
result.py Refactor return of first gen token in PD (#2986) 2025-04-01 12:28:27 +08:00
utils.py Update (#2978) 2025-03-23 16:39:35 +08:00
worker.py perf: Readd iteration logging for trtllm-bench. (#3039) 2025-04-01 08:13:09 +08:00