kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-16 07:53:55 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
0253036a4e
TensorRT-LLMs/tests/integration/defs/accuracy/references
History
2ez4bz 2480aedb73 [TRTLLM-5252][feat] Add fp8 support for Mistral Small 3.1 (#6731) 
This commit adds some level of FP8 support to Mistral Small 3.1 by:

* disabling quantization for the vision sub-model since `modelopt` does
  support quantizing it (yet).
* extending existing accuracy tests to use a modelopt produced FP8
  checkpoint.

Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
Signed-off-by: Wangshanshan <30051912+dominicshanshan@users.noreply.github.com>
2025-09-01 11:02:31 +08:00
..
cnn_dailymail.yaml [TRTLLM-5252][feat] Add fp8 support for Mistral Small 3.1 (#6731) 2025-09-01 11:02:31 +08:00
gpqa_diamond.yaml [https://nvbugs/5409414][fix] fix Not registered specs (#6660) 2025-08-07 17:55:53 +10:00
gsm8k.yaml [TRTLLM-5252][feat] Add fp8 support for Mistral Small 3.1 (#6731) 2025-09-01 11:02:31 +08:00
humaneval.yaml Update (#2978) 2025-03-23 16:39:35 +08:00
json_mode_eval.yaml [TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine) (#6300) 2025-08-07 05:53:48 -04:00
mmlu.yaml [TRTLLM-5252][feat] Add fp8 support for Mistral Small 3.1 (#6731) 2025-09-01 11:02:31 +08:00
mmmu.yaml [TRTLLM-6771][feat] Support MMMU for multimodal models (#6828) 2025-08-21 08:54:12 +08:00
passkey_retrieval_64k.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
passkey_retrieval_128k.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
SlimPajama-6B.yaml test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
zero_scrolls.yaml Update (#2978) 2025-03-23 16:39:35 +08:00