TensorRT-LLMs/tensorrt_llm/serve
Zheng Duan 4d0a5ad384
chore: gracefully exit disagg process in tests; better startup and logging (#5109)
Signed-off-by: Zheng Duan <200704041+zhengd-nv@users.noreply.github.com>
2025-06-13 14:03:55 +08:00
..
scripts [feat] support sharegpt downloading in benchmark_serving (#4578) 2025-05-30 17:27:53 +08:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [TRTLLM-5053] Refactoring and Unifying the Multimodal input preparation (#4506) 2025-06-03 12:02:07 -07:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py chore: gracefully exit disagg process in tests; better startup and logging (#5109) 2025-06-13 14:03:55 +08:00
openai_protocol.py [fix]: Fall back to HMAC to Avoid IPC Serialization Churn (#5074) 2025-06-13 11:37:50 +08:00
openai_server.py chore: Include prompt_token_ids only for context-only disagg requests (#5055) 2025-06-12 15:00:08 -04:00
postprocess_handlers.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
router.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00