kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-22 19:52:38 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
8564c5a41f
TensorRT-LLMs/tests/unittest/llmapi/apps
History
Pengyun Lin 039f7e3118
[https://nvbugspro.nvidia.com/bug/5243740][fix] deduce default max_tokens for trtllm-serve (#4265) 
* Deduce default max_tokens for trtllm-serve

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>

* Improve executor_config.max_seq_len assignment in TRT workflow

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>

* Enhance error message

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>

* Add deduced max_tokens test

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>

---------

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>
2025-05-19 00:34:40 +08:00
..
__init__.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_llm_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_llm_server.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_chat_multimodal.py feat: enhance trtllm serve multimodal (#3757) 2025-05-15 16:16:31 -07:00
_test_openai_chat_structural_tag.py Breaking change: perf: Enable scheduling overlap by default (#4174) 2025-05-15 14:27:36 +08:00
_test_openai_chat.py [https://nvbugspro.nvidia.com/bug/5243740][fix] deduce default max_tokens for trtllm-serve (#4265) 2025-05-19 00:34:40 +08:00
_test_openai_completions.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_consistent_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_metrics.py Breaking change: perf: Enable scheduling overlap by default (#4174) 2025-05-15 14:27:36 +08:00
_test_openai_misc.py feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
_test_openai_multi_chat.py update waive list (#3503) 2025-04-15 16:53:53 +08:00
_test_openai_multi_gpu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_multi_nodes.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_reasoning.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
_test_trtllm_serve_duplicated_args.py [feat] Allow overriding cli args with yaml file in trtllm-serve (#4164) 2025-05-08 21:19:05 -04:00
_test_trtllm_serve_example.py doc: add genai-perf benchmark & slurm multi-node for trtllm-serve doc (#3407) 2025-04-16 00:11:58 +08:00
_test_trtllm_serve_multimodal_example.py feat: enhance trtllm serve multimodal (#3757) 2025-05-15 16:16:31 -07:00
openai_server.py feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
README.md Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00

README.md

This directory contains the end-to-end tests for the LLM API applications in examples/apps.

These tests are triggered in the test_e2e.py.