Yilin Fan 2695d70d42 [None][feat] Add request timing breakdown option in benchmark_serving (#8128) ... Signed-off-by: nv-yilinf <206948969+nv-yilinf@users.noreply.github.com>		2025-10-10 09:24:54 -07:00
..
scripts	[None][feat] Add request timing breakdown option in benchmark_serving (#8128)	2025-10-10 09:24:54 -07:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
chat_utils.py	[TRTLLM-6771][feat] Support MMMU for multimodal models (#6828)	2025-08-21 08:54:12 +08:00
cluster_storage.py	[TRTLLM-7846][feat] Http disagg-cluster management implemention (#7869)	2025-10-09 09:44:01 +08:00
disagg_auto_scaling.py	[TRTLLM-7846][feat] Http disagg-cluster management implemention (#7869)	2025-10-09 09:44:01 +08:00
harmony_adapter.py	[https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849)	2025-09-24 16:38:43 +08:00
metadata_server.py	feat: Add integration of etcd (#3738)	2025-06-03 20:01:44 +08:00
openai_disagg_server.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
openai_protocol.py	[TRTLLM-8413][chore] resolve sampling defaults in OpenAI API backend (#8121)	2025-10-06 06:09:43 -07:00
openai_server.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
postprocess_handlers.py	[https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849)	2025-09-24 16:38:43 +08:00
responses_utils.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
router.py	feat: Dynamically remove servers in PD (#5270)	2025-06-25 09:50:04 +08:00