mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-21 02:05:17 +08:00
11 lines
400 B
ReStructuredText
11 lines
400 B
ReStructuredText
Curl Completion Client
|
|
======================
|
|
Refer to the `trtllm-serve documentation <https://nvidia.github.io/TensorRT-LLM/commands/trtllm-serve.html>`_ for starting a server.
|
|
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/serve/curl_completion_client.sh.
|
|
|
|
.. literalinclude:: ../../../examples/serve/curl_completion_client.sh
|
|
:lines: 1-10
|
|
:language: bash
|
|
:linenos:
|