kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Claim support for QwQ 32B (#2877)

Browse Source 
Signed-off-by: Laikh Tewari <laikhtewari1@gmail.com>
This commit is contained in:
Laikh Tewari 2025-03-23 22:05:15 -07:00 committed by GitHub
parent 37644e22bc
commit 456a850e66
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
examples/qwen/README.md
View File

@ -56,6 +56,7 @@ In addition, there are two shared files in the parent folder [`examples`](../) f
| Qwen2.5-7B(-Instruct)| Y | Y | Y | Y | Y | Y | Y | Y | Ampere+ |
| Qwen2.5-32B(-Instruct)| Y | Y | Y | Y | Y | Y | Y | Y | Ampere+ |
| Qwen2.5-72B(-Instruct)| Y | Y | Y | Y* | Y | Y | Y | Y | Ampere+ |
| QwQ-32B | Y | Y | Y | Y | Y | Y | Y | Y | Ampere+ |
Please note that Y* sign means that the model does not support all the AWQ + TP combination.