mirror of https://github.com/vllm-project/vllm.git synced 2026-06-06 00:16:14 +00:00

Files

T

History

wang.yuqi 1d694e78c9 [Examples][last/6] Resettle examples. (#41084 )

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2026-05-07 19:42:12 -07:00

disagg_proxy_demo.py

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

disagg_proxy_multiturn.py

[Examples][last/6] Resettle examples. (#41084 )

2026-05-07 19:42:12 -07:00

example_mm_serve.py

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

kv_events.sh

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

moriio_toy_proxy_server.py

[ROCm] Profiler api support for ROCm MORI toy proxy server in PD Disaggregation (#40264 )

2026-05-07 16:58:38 +08:00

README.md

[Examples] Resettle Disaggregated examples. (#40759 )

2026-05-06 01:20:38 -07:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.