kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-22 19:52:38 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
cbca6505ff
TensorRT-LLMs/tests/unittest/llmapi/apps
History
Yixin Dong c90ebadd84
feat: Support the Structural Tag in guided decoding (#4066) 
* finish

Signed-off-by: Ubospica <ubospica@gmail.com>

* update

Signed-off-by: Ubospica <ubospica@gmail.com>

* update

Signed-off-by: Ubospica <ubospica@gmail.com>

* fix

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* exc overlap scheduler

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* add test

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* fix api ref

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

---------

Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
Co-authored-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-05-12 17:24:50 +08:00
..
__init__.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_llm_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_llm_server.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_chat_multimodal.py feat: trtllm-serve multimodal support (#3590) 2025-04-19 05:01:28 +08:00
_test_openai_chat_structural_tag.py feat: Support the Structural Tag in guided decoding (#4066) 2025-05-12 17:24:50 +08:00
_test_openai_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_completions.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_consistent_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_metrics.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_misc.py feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
_test_openai_multi_chat.py update waive list (#3503) 2025-04-15 16:53:53 +08:00
_test_openai_multi_gpu.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_multi_nodes.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_openai_reasoning.py feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
_test_trtllm_serve_duplicated_args.py [feat] Allow overriding cli args with yaml file in trtllm-serve (#4164) 2025-05-08 21:19:05 -04:00
_test_trtllm_serve_example.py doc: add genai-perf benchmark & slurm multi-node for trtllm-serve doc (#3407) 2025-04-16 00:11:58 +08:00
_test_trtllm_serve_multimodal_example.py feat: trtllm-serve multimodal support (#3590) 2025-04-19 05:01:28 +08:00
openai_server.py feat: support abort disconnected requests (#3214) 2025-04-07 16:14:58 +08:00
README.md Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00

README.md

This directory contains the end-to-end tests for the LLM API applications in examples/apps.

These tests are triggered in the test_e2e.py.