TensorRT-LLMs/tensorrt_llm/executor
Iman Tabrizian c539750d42
fix: Allow context_and_generation request type in disagg overlap (#3489)
Signed-off-by: Iman Tabrizian <itabrizian@nvidia.com>
2025-04-11 16:15:01 -07:00
..
__init__.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
executor.py Update (#2978) 2025-03-23 16:39:35 +08:00
ipc.py chore: code cleanup for error logging and SharedMemory in proxy.py (#3432) 2025-04-10 21:57:06 +08:00
postproc_worker.py chore: code cleanup for error logging and SharedMemory in proxy.py (#3432) 2025-04-10 21:57:06 +08:00
proxy.py chore: code cleanup for error logging and SharedMemory in proxy.py (#3432) 2025-04-10 21:57:06 +08:00
request.py Update (#2978) 2025-03-23 16:39:35 +08:00
result.py breaking change: perf: Make ipc_periodically the default responses_handler (#3102) 2025-04-08 10:36:39 +08:00
utils.py chore: code cleanup for error logging and SharedMemory in proxy.py (#3432) 2025-04-10 21:57:06 +08:00
worker.py fix: Allow context_and_generation request type in disagg overlap (#3489) 2025-04-11 16:15:01 -07:00