Enwei Zhu 3fa19ffa4e test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483) ... * add gsm8k Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix gsm8k Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * add gpqa Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * conditional import lm_eval Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * gpqa in lm_eval Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * system prompt Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * shuffle Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update AA prompt and regex Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * revert AA prompt and regex Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * integration to tests Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * add DS-R1 Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix and clean Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update tests Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * clean up Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * free_gpu_memory_fraction=0.8 Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> --------- Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>		2025-04-22 07:38:16 +08:00
..
cnn_dailymail.yaml	test: add torch flow test case in qa test list (#3404)	2025-04-11 16:57:41 +08:00
gpqa_diamond.yaml	test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483)	2025-04-22 07:38:16 +08:00
gsm8k.yaml	test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483)	2025-04-22 07:38:16 +08:00
humaneval.yaml	Update (#2978)	2025-03-23 16:39:35 +08:00
mmlu.yaml	test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483)	2025-04-22 07:38:16 +08:00
passkey_retrieval_64k.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
passkey_retrieval_128k.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
SlimPajama-6B.yaml	test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982)	2025-03-25 07:34:10 +08:00
zero_scrolls.yaml	Update (#2978)	2025-03-23 16:39:35 +08:00