mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-19 01:05:12 +08:00
11 lines
360 B
ReStructuredText
11 lines
360 B
ReStructuredText
Curl Chat Client
|
|
================
|
|
|
|
Refer to the `trtllm-serve documentation <https://nvidia.github.io/TensorRT-LLM/commands/trtllm-serve.html>`_ for starting a server.
|
|
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/serve/curl_chat_client.sh.
|
|
|
|
.. literalinclude:: ../../../examples/serve/curl_chat_client.sh
|
|
:language: bash
|
|
:linenos:
|