TensorRT-LLMs/tensorrt_llm/executor
Yilin Fan dd29063538
[feat] Add llm args to tune python gc threshold (#5141)
Signed-off-by: Yilin Fan <206948969+nv-yilinf@users.noreply.github.com>
2025-06-16 17:45:22 +08:00
..
__init__.py chore: rename ExecutorBindingsWorker/Proxy (#4716) 2025-05-29 10:32:35 +08:00
executor.py [feat] Add llm args to tune python gc threshold (#5141) 2025-06-16 17:45:22 +08:00
ipc.py [fix]: Fall back to HMAC to Avoid IPC Serialization Churn (#5074) 2025-06-13 11:37:50 +08:00
postproc_worker.py feat: Support post_proc for bench (#5122) 2025-06-15 13:02:38 +08:00
proxy.py [feat] Add llm args to tune python gc threshold (#5141) 2025-06-16 17:45:22 +08:00
request.py [TRTLLM-5007][feat] Add multimodal hashing support (image hashing) (#4145) 2025-06-10 01:59:56 +08:00
result.py perf: avoid dynamic import overhead in is_llm_response with duck typing (#5110) 2025-06-15 07:45:02 +08:00
serialization.py chore: improve disagg test failure detection (#4738) 2025-06-15 01:28:26 +08:00
utils.py perf: avoid dynamic import overhead in is_llm_response with duck typing (#5110) 2025-06-15 07:45:02 +08:00
worker.py [feat] Add llm args to tune python gc threshold (#5141) 2025-06-16 17:45:22 +08:00