TensorRT-LLMs/tensorrt_llm/serve
zhanghaotong 1026069a2b
[None][feat] Add opentelemetry tracing (#5897)
Signed-off-by: Zhang Haotong <zhanghaotong.zht@antgroup.com>
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Zhang Haotong <zhanghaotong.zht@alibaba-inc.com>
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
2025-10-27 18:51:07 +08:00
..
scripts [None][doc] add visualization of perf metrics in time breakdown tool doc (#8530) 2025-10-23 22:09:21 -04:00
__init__.py Update TensorRT-LLM (#2820) 2025-02-25 21:21:49 +08:00
chat_utils.py [TRTLLM-8737][feat] Support media_io_kwargs on trtllm-serve (#8528) 2025-10-24 12:53:40 -04:00
cluster_storage.py [TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215) 2025-10-21 17:25:07 -04:00
disagg_auto_scaling.py [TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215) 2025-10-21 17:25:07 -04:00
harmony_adapter.py [https://nvbugs/5521799][fix] Trim incorrectly generated harmony messages (#7849) 2025-09-24 16:38:43 +08:00
metadata_server.py feat: Add integration of etcd (#3738) 2025-06-03 20:01:44 +08:00
openai_disagg_server.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
openai_protocol.py [None][feat] Support cached tokens for Openai server (#7637) 2025-10-16 20:51:37 +08:00
openai_server.py [None][feat] Add opentelemetry tracing (#5897) 2025-10-27 18:51:07 +08:00
postprocess_handlers.py [None][feat] Support Qwen3 reasoning parser (#8000) 2025-10-21 14:08:39 +08:00
responses_utils.py [None][feat] perf_metrics endpoint functionality improvement (#8005) 2025-10-02 17:43:25 -07:00
router.py [TRTLLM-7843][feat] implement disagg cluster auto-scaling (#8215) 2025-10-21 17:25:07 -04:00