Enwei Zhu 3fa19ffa4e test [TRTLLM-4477,TRTLLM-4481]: Accuracy test improvement (Part 3.5): Support GSM8K and GPQA (#3483) ... * add gsm8k Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix gsm8k Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * add gpqa Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * conditional import lm_eval Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * gpqa in lm_eval Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * system prompt Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * shuffle Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update AA prompt and regex Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * revert AA prompt and regex Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * integration to tests Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * add DS-R1 Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix and clean Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update tests Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * update Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * clean up Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * free_gpu_memory_fraction=0.8 Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> * fix Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com> --------- Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>		2025-04-22 07:38:16 +08:00
..
run_llm_fp8_quant_llama_70b.py	Update (#2978)	2025-03-23 16:39:35 +08:00
run_llm_lad_mtbench.py	Update (#2978)	2025-03-23 16:39:35 +08:00
run_llm_quickstart_atexit.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_bert.py	feat: Add FP8 support for SM 120 (#3248)	2025-04-14 16:05:41 -07:00
test_bindings.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_chatglm.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_commandr.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_draft_target_model.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_eagle.py	test: Get Eagle tests working (#3593)	2025-04-20 00:50:57 +08:00
test_enc_dec.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_exaone.py	Add EXAONE-Deep (#3054)	2025-03-26 14:24:04 +08:00
test_gemma.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_gpt.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_gptj.py	test:remove opt/mpt/gptj/gptneox/bloom/falcon/baichuan/internlm/deep_… (#2987)	2025-03-24 14:18:06 +08:00
test_granite.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_internlm.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_llama.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_llm_api_with_mpi.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_mamba.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_medusa.py	Add support for Phi-4-mini (#2990)	2025-04-02 08:34:39 +08:00
test_mistral.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_mixtral.py	Fix ModelOpt Mixtral AWQ OOM (#3714)	2025-04-21 19:14:14 +08:00
test_multimodal.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_nemotron_nas.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_nemotron.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_openai.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_phi.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_prompt_lookup.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_qwen2audio.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_qwen.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00
test_qwenvl.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_recurrentgemma.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_redrafter.py	Update (#2978)	2025-03-23 16:39:35 +08:00
test_whisper.py	move the reset models into examples/models/core directory (#3555)	2025-04-19 20:48:59 -07:00