kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
67e487bac6
TensorRT-LLMs/examples/configs/README.md
Anish Shanbhag 6a6317727b
[TRTLLM-8680][doc] Add table with one-line deployment commands to docs (#8173) 
Signed-off-by: Anish Shanbhag <ashanbhag@nvidia.com>
2025-11-03 17:42:41 -08:00

479 B
Raw Blame History

Recommended LLM API Configuration Settings

This directory contains recommended LLM API performance settings for popular models. They can be used out-of-the-box with trtllm-serve via the --extra_llm_api_options CLI flag, or you can adjust them to your specific use case.

For model-specific deployment guides, please refer to the official documentation.