TensorRT-LLMs/tests/integration/defs/accuracy/references/humaneval.yaml
Kaiyu Xie 2631f21089
Update (#2978)
Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
2025-03-23 16:39:35 +08:00

13 lines
282 B
YAML

bigcode/santacoder:
- accuracy: 31.688
bigcode/starcoder2-3b:
- accuracy: 30.339
bigcode/starcoder2-15b:
- quant_algo: W8A8_SQ_PER_CHANNEL
accuracy: 24.209
nvidia/Minitron-4B-Base:
- accuracy: 33.058
- quant_algo: FP8
kv_cache_quant_algo: FP8
accuracy: 34.159