Shunkangz d5354897c0 feat: Dynamically remove servers in PD (#5270) ... Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>		2025-06-25 09:50:04 +08:00
..
scripts	feat: Add no_kv_cache_reuse option and streaming support for trtllm serve bench (#4971)	2025-06-18 13:37:31 +08:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
chat_utils.py	[TRTLLM-5053] Refactoring and Unifying the Multimodal input preparation (#4506)	2025-06-03 12:02:07 -07:00
metadata_server.py	feat: Add integration of etcd (#3738)	2025-06-03 20:01:44 +08:00
openai_disagg_server.py	feat: Dynamically remove servers in PD (#5270)	2025-06-25 09:50:04 +08:00
openai_protocol.py	[fix]: Fall back to HMAC to Avoid IPC Serialization Churn (#5074)	2025-06-13 11:37:50 +08:00
openai_server.py	[TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default (#5312)	2025-06-20 03:01:10 +08:00
postprocess_handlers.py	feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)	2025-05-06 08:13:04 +08:00
router.py	feat: Dynamically remove servers in PD (#5270)	2025-06-25 09:50:04 +08:00