kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-16 07:53:55 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[None][fix] glm engine build dtype (#11246)

Browse Source 
Signed-off-by: Mandar Deshpande <razzormandar@gmail.com>
This commit is contained in:
Mandar Deshpande 2026-02-11 21:27:04 -08:00 committed by GitHub
parent e0b11d6ea0
commit 936220e746
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/models/core/glm-4-9b/README.md
View File

@ -116,7 +116,7 @@ Normally, the `trtllm-build` command only requires a single GPU, but you can ena
```bash
# GLM-4-9B: single-gpu engine with dtype float16, GPT Attention plugin, Gemm plugin
trtllm-build --checkpoint_dir trt_ckpt/glm_4_9b/fp16/1-gpu \
--gemm_plugin float16 \
--gemm_plugin bfloat16 \
--output_dir trt_engines/glm_4_9b/fp16/1-gpu
```