kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-26 21:53:30 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
cdf5ae1547
TensorRT-LLMs/tests/integration/defs/accuracy/references
History
Ivy Zhang 7666bec7c4
[TRTQA-2861][test]: add nemotron and llama4 cases into qa test (#4053) 
* add MMLU, GPQADiamond check for llama-4 models

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* add nomotron cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* add online quant test cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* remove trt flow cases

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update threshold

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* adjust parallelism strategy

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix fail

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* update sanity list

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* fix comment

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

* skip nemotron-h test case

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>

---------

Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Larry <197874197+LarryXFly@users.noreply.github.com>
2025-05-08 18:10:41 +08:00
..
cnn_dailymail.yaml [TRTQA-2861][test]: add nemotron and llama4 cases into qa test (#4053) 2025-05-08 18:10:41 +08:00
gpqa_diamond.yaml [TRTQA-2861][test]: add nemotron and llama4 cases into qa test (#4053) 2025-05-08 18:10:41 +08:00
gsm8k.yaml [TRTQA-2861][test]: add nemotron and llama4 cases into qa test (#4053) 2025-05-08 18:10:41 +08:00
humaneval.yaml Update (#2978) 2025-03-23 16:39:35 +08:00
mmlu.yaml [TRTQA-2861][test]: add nemotron and llama4 cases into qa test (#4053) 2025-05-08 18:10:41 +08:00
passkey_retrieval_64k.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
passkey_retrieval_128k.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
SlimPajama-6B.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
zero_scrolls.yaml Update (#2978) 2025-03-23 16:39:35 +08:00