Wangjue Yao 9865d3d770 [None][feat] Support cached tokens for Openai server (#7637) ... Signed-off-by: wjueyao <wyao123@terpmail.umd.edu> Co-authored-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>		2025-10-16 20:51:37 +08:00
..
scripts	[None][feat] Add request timing breakdown option in benchmark_serving (#8128)	2025-10-10 09:24:54 -07:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
chat_utils.py	[TRTLLM-6771][feat] Support MMMU for multimodal models (#6828)	2025-08-21 08:54:12 +08:00
cluster_storage.py	[TRTLLM-7846][feat] implement etcd storage for disagg cluster (#8210)	2025-10-14 16:48:41 -04:00
disagg_auto_scaling.py	[TRTLLM-7846][feat] implement etcd storage for disagg cluster (#8210)	2025-10-14 16:48:41 -04:00
harmony_adapter.py	[https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849)	2025-09-24 16:38:43 +08:00
metadata_server.py	feat: Add integration of etcd (#3738)	2025-06-03 20:01:44 +08:00
openai_disagg_server.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
openai_protocol.py	[None][feat] Support cached tokens for Openai server (#7637)	2025-10-16 20:51:37 +08:00
openai_server.py	[None][feat] Support cached tokens for Openai server (#7637)	2025-10-16 20:51:37 +08:00
postprocess_handlers.py	[None][feat] Support cached tokens for Openai server (#7637)	2025-10-16 20:51:37 +08:00
responses_utils.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
router.py	feat: Dynamically remove servers in PD (#5270)	2025-06-25 09:50:04 +08:00