mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-21 18:25:20 +08:00
11 lines
436 B
ReStructuredText
11 lines
436 B
ReStructuredText
Curl Completion Client
|
|
======================
|
|
Refer to the `trtllm-serve documentation <https://nvidia.github.io/TensorRT-LLM/commands/trtllm-serve.html>`_ for starting a server.
|
|
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/blob/9ba14263db0045ed3fa0860f949b5ce320107eb3/examples/serve/curl_completion_client.sh.
|
|
|
|
.. literalinclude:: ../../../examples/serve/curl_completion_client.sh
|
|
:lines: 1-10
|
|
:language: bash
|
|
:linenos:
|