TensorRT-LLMs/tests/unittest/llmapi/apps
2025-12-19 01:20:42 -08:00
..
__init__.py test: reorganize tests folder hierarchy (#2996) 2025-03-27 12:07:53 +08:00
_test_disagg_serving_multi_nodes_service_discovery.py [TRTLLM-9181][feat] improve disagg-server prometheus metrics; synchronize workers' clocks when workers are dynamic (#9726) 2025-12-16 05:16:32 -08:00
_test_disagg_serving_multi_nodes.py [TRTLLM-9840][test] switch ucx backend to default backend (#10101) 2025-12-18 18:54:15 -08:00
_test_llm_chat.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_llm_server.py Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
_test_openai_cache_salt.py [TRTLLM-7398][feat] Support KV cache salting for secure KV cache reuse (#7106) 2025-09-06 17:58:32 -04:00
_test_openai_chat_guided_decoding.py [TRTLLM-9295][fix] use greedy decoding in test_openai_compatible_json_schema (#9305) 2025-11-20 08:32:23 +01:00
_test_openai_chat_harmony.py [None][chore] Enable multiple postprocess workers tests for chat completions api (#7602) 2025-09-15 12:16:44 +08:00
_test_openai_chat_multimodal.py [https://nvbugs/5685428][fix] fix test_openai_chat_multimodal.py (#9406) 2025-11-24 16:56:33 -08:00
_test_openai_chat.py [TRTLLM-8598][feat] enable n > 1 in OpenAI API with PyTorch backend (#8951) 2025-11-07 17:47:35 -08:00
_test_openai_completions.py [TRTLLM-8598][feat] enable n > 1 in OpenAI API with PyTorch backend (#8951) 2025-11-07 17:47:35 -08:00
_test_openai_consistent_chat.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
_test_openai_lora.py [https://nvbugs/5390853][fix] Fix _test_openai_lora.py - disable cuda graph (#6965) 2025-08-17 16:56:16 +03:00
_test_openai_metrics.py [TRTLLM-8274][feat] Check if executor is shutdown in /health entrypoint (#9057) 2025-12-04 13:49:40 +08:00
_test_openai_misc.py [https://nvbugs/5718004][fix] Add warmup for cancellation test (#9860) 2025-12-11 12:20:33 +08:00
_test_openai_mmencoder.py [https://nvbugs/5747911][fix] Use offline data path for the unit test of mmencoder server (#10135) 2025-12-18 15:19:23 -08:00
_test_openai_multi_chat.py [TRTLLM-8682][chore] Remove auto_parallel module (#8329) 2025-10-22 20:53:08 -04:00
_test_openai_multi_gpu.py [BREAKING CHANGE]: change default backend to PyTorch in trtllm-serve (#5717) 2025-07-21 21:09:43 +08:00
_test_openai_multi_nodes.py [BREAKING CHANGE]: change default backend to PyTorch in trtllm-serve (#5717) 2025-07-21 21:09:43 +08:00
_test_openai_perf_metrics.py [TRTLLM-6549][feat] add perf metrics endpoint to openai server and openai disagg server (#6985) 2025-08-26 15:34:44 +08:00
_test_openai_prometheus.py [None][feat] Add trtllm_ prefix for exposed metrics (#8845) 2025-11-06 15:27:18 +08:00
_test_openai_reasoning.py [None][feat] Support Qwen3 reasoning parser (#8000) 2025-10-21 14:08:39 +08:00
_test_openai_responses.py [None][infra] Update waive and waive failed tests for main branch on 12/19 (#10151) 2025-12-19 01:20:42 -08:00
_test_openai_tool_call.py [TRTLLM-8214][feat] Support Qwen3 tool parser (#8216) 2025-10-29 15:48:29 +08:00
_test_trtllm_serve_benchmark.py [TRTLLM-7070][feat] add gpt-oss chunked prefill tests (#7779) 2025-09-22 00:12:43 -07:00
_test_trtllm_serve_duplicated_args.py chore: update trtllm-serve usage doc by removing backend parameter when it use torch as backend. (#6419) 2025-07-30 11:11:06 -04:00
_test_trtllm_serve_example.py [TRTLLM-9860][doc] Add docs and examples for Responses API (#9946) 2025-12-14 21:46:13 -08:00
_test_trtllm_serve_lora.py [5830][feat] Improve LoRA cache memory control (#6220) 2025-07-31 09:26:38 +03:00
_test_trtllm_serve_multimodal_benchmark.py [https://nvbugs/5494698][fix] skip gemma3 27b on blackwell (#7505) 2025-09-10 21:09:27 +08:00
_test_trtllm_serve_multimodal_example.py [TRTLLM-8737][feat] Support media_io_kwargs on trtllm-serve (#8528) 2025-10-24 12:53:40 -04:00
_test_trtllm_serve_top_logprobs.py [None] [fix] Revert "[None] [feat] add eos_token_id in generation_config to sampling params" (#10002) 2025-12-15 08:52:52 -08:00
openai_server.py [TRTLLM-9181][feat] improve disagg-server prometheus metrics; synchronize workers' clocks when workers are dynamic (#9726) 2025-12-16 05:16:32 -08:00
README.md [TRTLLM-8214][feat] Support Qwen3 tool parser (#8216) 2025-10-29 15:48:29 +08:00
test_chat_utils.py [None][feat] Support custom chat template for tool calling (#9297) 2025-11-25 22:07:04 +08:00
test_disagg_serving_perf_metrics.py [https://nvbugs/5726066][fix] fix auto-scaling related failures (#9845) 2025-12-18 16:37:48 -05:00
test_harmony_channel_validation.py [https://nvbugs/5521799][fix] add harmony channel validation (#8837) 2025-11-03 02:31:54 -08:00
test_tool_parsers.py [TRTLLM-9604][feat] DS R1 & V3.1 tool parser (#10010) 2025-12-19 17:20:03 +08:00
utils.py [TRTLLM-9181][feat] improve disagg-server prometheus metrics; synchronize workers' clocks when workers are dynamic (#9726) 2025-12-16 05:16:32 -08:00

This directory contains the end-to-end tests for trtllm-serve.

These tests are triggered in the test_e2e.py.