mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-30 15:43:19 +08:00
c6e2111f4e
* feat: enhance trtllm serve multimodal 1. made the load_image and load_video asynchronous 2. add image_encoded input support to be compatible with genai-perf 3. support text-only on multimodal mdoels(currently, Qwen2-VL & Qwen2.5-VL) Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * add test Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * fix bandit Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * trimming uils Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * trimming for test Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * genai perf command fix Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * command fix Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * refactor chat_utils Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> * stress test genai-perf command Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> --------- Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| _test_llm_chat.py | ||
| _test_llm_server.py | ||
| _test_openai_chat_multimodal.py | ||
| _test_openai_chat_structural_tag.py | ||
| _test_openai_chat.py | ||
| _test_openai_completions.py | ||
| _test_openai_consistent_chat.py | ||
| _test_openai_metrics.py | ||
| _test_openai_misc.py | ||
| _test_openai_multi_chat.py | ||
| _test_openai_multi_gpu.py | ||
| _test_openai_multi_nodes.py | ||
| _test_openai_reasoning.py | ||
| _test_trtllm_serve_duplicated_args.py | ||
| _test_trtllm_serve_example.py | ||
| _test_trtllm_serve_multimodal_example.py | ||
| openai_server.py | ||
| README.md | ||
This directory contains the end-to-end tests for the LLM API applications in examples/apps.
These tests are triggered in the test_e2e.py.