Anurag Mukkara b15f57763d tests: PyTorch multimodal using keyword match (#4215) ... * keyword accuracy check for pytorch multimodal Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com> * Change keywords for some prompts Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com> * Delete full text answers Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com> * Cleanup debug code Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com> --------- Signed-off-by: Anurag Mukkara <134339030+amukkara@users.noreply.github.com>		2025-05-14 17:18:43 +08:00
..
_llmapi_perf_evaluator	Update (#2978)	2025-03-23 16:39:35 +08:00
accuracy	CI: add fp8/fp4 ci on Qwen3-30B-A3B (#4266)	2025-05-14 14:38:04 +08:00
cpp	Refactor: Restructure C++ tests for better modularisation of non-shared code (#4027)	2025-05-09 19:16:51 +01:00
deterministic	chore: Cleanup deprecated APIs from LLM-API (part 1/2) (#3732)	2025-05-07 13:20:25 +08:00
disaggregated	feat: add kv cache aware router (#3831)	2025-05-12 07:23:57 -04:00
examples	test: Validate FP8 and LoRA for Gemma3 (#3670)	2025-05-13 17:28:02 -07:00
llmapi	chore: refactor llmapi e2e tests (#3803)	2025-05-05 07:37:24 +08:00
perf	test: fix for perf test script issue (#4230)	2025-05-13 10:29:20 +08:00
stress_test	fix: trtllm-serve hang in stress test and ds v3 stress parameter update (#3836)	2025-05-06 16:52:30 +08:00
sysinfo	Update (#2978)	2025-03-23 16:39:35 +08:00
__init__.py	Update (#2978)	2025-03-23 16:39:35 +08:00
.test_durations	[TRTLLM-5081] [test] Align parametrize_with_ids to the pytest behavior (#4090)	2025-05-13 07:41:51 +08:00
agg_unit_mem_df.csv	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
ci_profiler.py	Update (#2978)	2025-03-23 16:39:35 +08:00
common.py	[TRTLLM-4763][test] Accuracy test improvement (Part 3.6): Deprecate mmlu_llmapi.py (#3802)	2025-04-23 23:05:13 +08:00
conftest.py	feat: Support Mistral Small 3.1 24B VLM in TRT workflow (#4183)	2025-05-14 03:47:22 +08:00
local_venv.py	tests: https://nvbugs/5219534 remove failed tests from test list (#4113)	2025-05-12 14:13:40 +08:00
pytest.ini	chore: Refine attention backend interface. (#3271)	2025-04-09 02:34:53 +08:00
runner_interface.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_cache.py	chore: clean some ci of qa test (#3083)	2025-03-31 14:30:41 +08:00
test_cases.yml	Update (#2978)	2025-03-23 16:39:35 +08:00
test_e2e.py	tests: PyTorch multimodal using keyword match (#4215)	2025-05-14 17:18:43 +08:00
test_list_parser.py	infra: Add test list name check (#3097)	2025-04-20 23:02:16 +08:00
test_list_validation.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_mlpf_results.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_sanity.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_unittests.py	test: reorganize tests folder hierarchy (#2996)	2025-03-27 12:07:53 +08:00
trt_test_alternative.py	Add thread leak check and fix thread/memory leak issues. (#3270)	2025-04-08 19:03:18 +08:00