TensorRT-LLMs/tests/integration/defs/examples
Ivy Zhang c91d03fa0a
test: move mistral / mixtral test cases in QA test list into the new accuracy test suite (#3440)
* add mistral-7b-v0.1 torch flow test case

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* rearrange mistral

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* rearrange mixtral case

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* remove api function test

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* move mistral nemo cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* move mixtral cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update threshold

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix failure

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix name

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix failure cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update list

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update threshold

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* remove awq llmapi test

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* adjust threshold

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix ci

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix partial comments

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix path

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update thres

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* remove duplicate test case

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix ci

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

---------

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
2025-05-09 13:32:02 +08:00
..
run_llm_fp8_quant_llama_70b.py Update (#2978) 2025-03-23 16:39:35 +08:00
run_llm_lad_mtbench.py Update (#2978) 2025-03-23 16:39:35 +08:00
run_llm_quickstart_atexit.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_bert.py feat: Add FP8 support for SM 120 (#3248) 2025-04-14 16:05:41 -07:00
test_bindings.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_chatglm.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_commandr.py test: [CI] Add failed cases into waives.txt (#3777) 2025-04-24 09:36:05 +08:00
test_draft_target_model.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_eagle.py [https://nvbugspro.nvidia.com/bug/5260676]test: skip fp8 quantization case for pre-ada (#4095) 2025-05-09 13:30:16 +08:00
test_enc_dec.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_exaone.py chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00
test_gemma.py [TRTLLM-4763][test] Accuracy test improvement (Part 3.6): Deprecate mmlu_llmapi.py (#3802) 2025-04-23 23:05:13 +08:00
test_gpt.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_gptj.py test:remove opt/mpt/gptj/gptneox/bloom/falcon/baichuan/internlm/deep_… (#2987) 2025-03-24 14:18:06 +08:00
test_granite.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_internlm.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_llama.py fix:https://nvbugs/5246733 (#3989) 2025-05-01 22:52:31 +08:00
test_llm_api_with_mpi.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_mamba.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_medusa.py Add support for Phi-4-mini (#2990) 2025-04-02 08:34:39 +08:00
test_mistral.py test: move mistral / mixtral test cases in QA test list into the new accuracy test suite (#3440) 2025-05-09 13:32:02 +08:00
test_mixtral.py test: move mistral / mixtral test cases in QA test list into the new accuracy test suite (#3440) 2025-05-09 13:32:02 +08:00
test_multimodal.py chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00
test_nemotron_nas.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_nemotron.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_openai.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_phi.py chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00
test_prompt_lookup.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_qwen2audio.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
test_qwen.py update waives & tests (#3887) 2025-04-28 14:29:35 +08:00
test_qwenvl.py test: [CI] Add failed cases into waives.txt (#3777) 2025-04-24 09:36:05 +08:00
test_recurrentgemma.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_redrafter.py Update (#2978) 2025-03-23 16:39:35 +08:00
test_whisper.py move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00