Michal Guzek 24153c068e [TRTLLM-4932] Add QA accuracy tests for NIM-prioritized models (#4242) ... * Add tests Signed-off-by: moraxu <mguzek@nvidia.com> * Add tests v2 Signed-off-by: moraxu <mguzek@nvidia.com> * Add fixes Signed-off-by: moraxu <mguzek@nvidia.com> * Skip fp8 test for Ultra Signed-off-by: moraxu <mguzek@nvidia.com> * Add tests for Phi Signed-off-by: moraxu <mguzek@nvidia.com> * Skip tests for Phi Signed-off-by: moraxu <mguzek@nvidia.com> * Skip tests for Phi - fix Signed-off-by: moraxu <mguzek@nvidia.com> * Skip tests for Phi - comment out acc refs Signed-off-by: moraxu <mguzek@nvidia.com> * Add more test granularity Signed-off-by: moraxu <mguzek@nvidia.com> * Fix examples_test_list.txt Signed-off-by: moraxu <mguzek@nvidia.com> * Update test list file Signed-off-by: moraxu <mguzek@nvidia.com> * Update yaml files Signed-off-by: moraxu <mguzek@nvidia.com> * Address review comments Signed-off-by: moraxu <mguzek@nvidia.com> * Remove MMLU tests Signed-off-by: moraxu <mguzek@nvidia.com> * Add remaining models Signed-off-by: moraxu <mguzek@nvidia.com> --------- Signed-off-by: moraxu <mguzek@nvidia.com>		2025-05-24 19:17:21 +08:00
..
cnn_dailymail.yaml	[TRTLLM-4932] Add QA accuracy tests for NIM-prioritized models (#4242)	2025-05-24 19:17:21 +08:00
gpqa_diamond.yaml	[TRTLLM-4932] Add QA accuracy tests for NIM-prioritized models (#4242)	2025-05-24 19:17:21 +08:00
gsm8k.yaml	[TRTLLM-4932] Add QA accuracy tests for NIM-prioritized models (#4242)	2025-05-24 19:17:21 +08:00
humaneval.yaml	Update (#2978)	2025-03-23 16:39:35 +08:00
mmlu.yaml	[TRTLLM-4932] Add QA accuracy tests for NIM-prioritized models (#4242)	2025-05-24 19:17:21 +08:00
passkey_retrieval_64k.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
passkey_retrieval_128k.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
SlimPajama-6B.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
zero_scrolls.yaml	Update (#2978)	2025-03-23 16:39:35 +08:00