kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-04 10:11:47 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
227d42e492
TensorRT-LLMs/tests/unittest/llmapi/apps
History
dominicshanshan 6345074686
[None][chore] Weekly mass integration of release/1.1 -- rebase (#9522) 
Signed-off-by: yunruis <205571022+yunruis@users.noreply.github.com>
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
Signed-off-by: Mike Iovine <miovine@nvidia.com>
Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
Signed-off-by: qgai <qgai@nvidia.com>
Signed-off-by: Balaram Buddharaju <169953907+brb-nv@users.noreply.github.com>
Signed-off-by: Yan Chunwei <328693+Superjomn@users.noreply.github.com>
Signed-off-by: Junyi Xu <219237550+JunyiXu-nv@users.noreply.github.com>
Signed-off-by: Simeng Liu <simengl@nvidia.com>
Signed-off-by: nv-guomingz <137257613+nv-guomingz@users.noreply.github.com>
Signed-off-by: Jin Li <59594262+liji-nv@users.noreply.github.com>
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Signed-off-by: Vincent Zhang <vinczhang@nvidia.com>
Signed-off-by: peaceh <103117813+peaceh-nv@users.noreply.github.com>
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
Signed-off-by: Michal Guzek <moraxu@users.noreply.github.com>
Signed-off-by: Chang Liu (Enterprise Products) <9713593+chang-l@users.noreply.github.com>
Signed-off-by: leslie-fang25 <leslief@nvidia.com>
Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Signed-off-by: junq <22017000+QiJune@users.noreply.github.com>
Co-authored-by: yunruis <205571022+yunruis@users.noreply.github.com>
Co-authored-by: sunnyqgg <159101675+sunnyqgg@users.noreply.github.com>
Co-authored-by: brb-nv <169953907+brb-nv@users.noreply.github.com>
Co-authored-by: Yan Chunwei <328693+Superjomn@users.noreply.github.com>
Co-authored-by: JunyiXu-nv <219237550+JunyiXu-nv@users.noreply.github.com>
Co-authored-by: Simeng Liu <109828133+SimengLiu-nv@users.noreply.github.com>
Co-authored-by: Guoming Zhang <137257613+nv-guomingz@users.noreply.github.com>
Co-authored-by: Jin Li <59594262+liji-nv@users.noreply.github.com>
Co-authored-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Vincent Zhang <vcheungyi@163.com>
Co-authored-by: peaceh-nv <103117813+peaceh-nv@users.noreply.github.com>
Co-authored-by: Michal Guzek <moraxu@users.noreply.github.com>
Co-authored-by: Chang Liu <9713593+chang-l@users.noreply.github.com>
Co-authored-by: Leslie Fang <leslief@nvidia.com>
Co-authored-by: Shunkangz <182541032+Shunkangz@users.noreply.github.com>
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: QI JUN <22017000+QiJune@users.noreply.github.com>
2025-11-29 21:48:48 +08:00
..
__init__.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_disagg_serving_multi_nodes.py [https://nvbugs/5550671][fix] fix disagg-serving multinodes test failure (#8307) 2025-10-16 22:46:19 +08:00
_test_llm_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_llm_server.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_cache_salt.py [TRTLLM-7398][feat] Support KV cache salting for secure KV cache reuse (#7106) 2025-09-06 17:58:32 -04:00
_test_openai_chat_guided_decoding.py [TRTLLM-9295][fix] use greedy decoding in test_openai_compatible_json_schema (#9305) 2025-11-20 08:32:23 +01:00
_test_openai_chat_harmony.py [None][chore] Enable multiple postprocess workers tests for chat completions api (#7602) 2025-09-15 12:16:44 +08:00
_test_openai_chat_multimodal.py [https://nvbugs/5685428][fix] fix test_openai_chat_multimodal.py (#9406) 2025-11-24 16:56:33 -08:00
_test_openai_chat.py [TRTLLM-8598][feat] enable n > 1 in OpenAI API with PyTorch backend (#8951) 2025-11-07 17:47:35 -08:00
_test_openai_completions.py [TRTLLM-8598][feat] enable n > 1 in OpenAI API with PyTorch backend (#8951) 2025-11-07 17:47:35 -08:00
_test_openai_consistent_chat.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
_test_openai_lora.py [https://nvbugs/5390853][fix] Fix _test_openai_lora.py - disable cuda graph (#6965) 2025-08-17 16:56:16 +03:00
_test_openai_metrics.py [BREAKING CHANGE]: change default backend to PyTorch in trtllm-serve (#5717) 2025-07-21 21:09:43 +08:00
_test_openai_misc.py [TRTLLM-8269][test] do not explicitly pass temperature=0 to select greedy sampling (#8110) 2025-10-02 10:20:32 +02:00
_test_openai_mmencoder.py [TRTLLM-7326][feat] Add standalone multimodal encoder (#6743) 2025-08-19 21:42:50 -07:00
_test_openai_multi_chat.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
_test_openai_multi_gpu.py [BREAKING CHANGE]: change default backend to PyTorch in trtllm-serve (#5717) 2025-07-21 21:09:43 +08:00
_test_openai_multi_nodes.py [BREAKING CHANGE]: change default backend to PyTorch in trtllm-serve (#5717) 2025-07-21 21:09:43 +08:00
_test_openai_perf_metrics.py [TRTLLM-6549][feat] add perf metrics endpoint to openai server and openai disagg server (#6985) 2025-08-26 15:34:44 +08:00
_test_openai_prometheus.py [None][feat] Add trtllm_ prefix for exposed metrics (#8845) 2025-11-06 15:27:18 +08:00
_test_openai_reasoning.py [None][feat] Support Qwen3 reasoning parser (#8000) 2025-10-21 14:08:39 +08:00
_test_openai_responses.py [TRTLLM-7208][feat] Implement basic functionalities for Responses API (#7341) 2025-09-02 07:08:22 -04:00
_test_openai_tool_call.py [TRTLLM-8214][feat] Support Qwen3 tool parser (#8216) 2025-10-29 15:48:29 +08:00
_test_trtllm_serve_benchmark.py [TRTLLM-7070][feat] add gpt-oss chunked prefill tests (#7779) 2025-09-22 00:12:43 -07:00
_test_trtllm_serve_duplicated_args.py chore: update trtllm-serve usage doc by removing backend parameter when it use torch as backend. (#6419) 2025-07-30 11:11:06 -04:00
_test_trtllm_serve_example.py [None][chore] Enhance trtllm-serve example test (#6604) 2025-08-06 20:30:35 +08:00
_test_trtllm_serve_lora.py [5830][feat] Improve LoRA cache memory control (#6220) 2025-07-31 09:26:38 +03:00
_test_trtllm_serve_multimodal_benchmark.py [https://nvbugs/5494698][fix] skip gemma3 27b on blackwell (#7505) 2025-09-10 21:09:27 +08:00
_test_trtllm_serve_multimodal_example.py [TRTLLM-8737][feat] Support media_io_kwargs on trtllm-serve (#8528) 2025-10-24 12:53:40 -04:00
_test_trtllm_serve_top_logprobs.py [TRTLLM-1302][feat] Topk logprobs for TRT backend and top1 logprob for PyT backend (#6097) 2025-09-12 15:32:34 +08:00
openai_server.py [None][chore] Weekly mass integration of release/1.1 -- rebase (#9522) 2025-11-29 21:48:48 +08:00
README.md [TRTLLM-8214][feat] Support Qwen3 tool parser (#8216) 2025-10-29 15:48:29 +08:00
test_chat_utils.py [None][feat] Support custom chat template for tool calling (#9297) 2025-11-25 22:07:04 +08:00
test_harmony_channel_validation.py [https://nvbugs/5521799][fix] add harmony channel validation (#8837) 2025-11-03 02:31:54 -08:00
test_tool_parsers.py [None][fixes] Add tool call parsing fixes and Qwen3 coder parser (#8817) 2025-11-13 04:34:38 -08:00
utils.py [TRTLLM-7182][test] add multi-nodes test for disagg-serving (#7470) 2025-09-24 08:31:56 +08:00

README.md

This directory contains the end-to-end tests for trtllm-serve.

These tests are triggered in the test_e2e.py.