Lizhi Zhou 23d5280a90 [TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215) ... Signed-off-by: Lizhi Zhou <1432185+reasonsolo@users.noreply.github.com>		2025-10-21 17:25:07 -04:00
..
scripts	[None][feat] Add request timing breakdown option in benchmark_serving (#8128)	2025-10-10 09:24:54 -07:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
chat_utils.py	[TRTLLM-6771][feat] Support MMMU for multimodal models (#6828)	2025-08-21 08:54:12 +08:00
cluster_storage.py	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00
disagg_auto_scaling.py	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00
harmony_adapter.py	[https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849)	2025-09-24 16:38:43 +08:00
metadata_server.py	feat: Add integration of etcd (#3738)	2025-06-03 20:01:44 +08:00
openai_disagg_server.py	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00
openai_protocol.py	[None][feat] Support cached tokens for Openai server (#7637)	2025-10-16 20:51:37 +08:00
openai_server.py	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00
postprocess_handlers.py	[None][feat] Support Qwen3 reasoning parser (#8000)	2025-10-21 14:08:39 +08:00
responses_utils.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
router.py	[TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215)	2025-10-21 17:25:07 -04:00