TensorRT-LLMs/tests/unittest
William Zhang ca9537e17c
[TRTLLM-10858][feat] Multi-image support for EPD disagg (#11264)
* Why?

Prior to this commit, we only supported a single multimodal input for
E/P/D disaggregated serving.

* What?

This commit does a minor refactor of the multimodal embedding handles
that cross process boundaries to enable this.
Existing unit tests are updated accordingly to test this.

The `RequestOutput` has its `mm_embedding_handle` replaced in favor of
`disaggregated_params`, addressing a previous TODO.

Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
2026-02-11 20:50:00 -08:00
..
_torch [TRTLLM-10858][feat] Multi-image support for EPD disagg (#11264) 2026-02-11 20:50:00 -08:00
api_stability [TRTLLM-10858][feat] Multi-image support for EPD disagg (#11264) 2026-02-11 20:50:00 -08:00
bindings [TRTLLM-9527][feat] change context params and disagg params (step3) (#10495) 2026-01-27 16:34:17 +08:00
disaggregated [https://nvbugs/5826689][fix] replace etcd3 with etcd-sdk-python (#10886) 2026-02-09 23:53:40 +08:00
executor [https://nvbugs/5720482][fix] Fix test rpc streaming (#9902) 2025-12-13 01:14:43 -08:00
kv_cache_manager_v2_tests [None][feat] Enhance support for complex models (#11254) 2026-02-05 17:28:26 +08:00
llmapi [None][feat] Fully non-blocking pipeline parallelism executor loop. (#10349) 2026-02-10 15:43:28 +08:00
others [https://nvbugs/5761391][fix] Include triton-kernels as a packaged dependency (#10471) 2026-01-28 19:56:32 -08:00
scaffolding [None][feat] Refactor scaffolding streaming feature and fix openai wo… (#8622) 2025-10-30 16:02:40 +08:00
tools [None][feat] Add performance alignment to layer-wise benchmarks (#11018) 2026-01-29 14:01:51 +08:00
trt [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
utils [None][feat] Fully non-blocking pipeline parallelism executor loop. (#10349) 2026-02-10 15:43:28 +08:00
conftest.py [TRTLLM-10415][feat] Dump thread stacks for hanging tests before time… (#10708) 2026-01-29 20:43:34 +08:00
dump_checkpoint_stats.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
gc_utils.py [nvbug 5273941] fix: broken cyclic reference detect (#5417) 2025-07-01 20:12:55 +08:00
profile_utils.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
pytest.ini [TRTLLM-9181][feat] improve disagg-server prometheus metrics; synchronize workers' clocks when workers are dynamic (#9726) 2025-12-16 05:16:32 -08:00
test_model_runner_cpp.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
test_pip_install.py [TRTLLM-10561][infra] Fix jaraco-context and wheel vulnerability (#10901) 2026-02-03 09:54:11 +08:00