mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-22 02:35:21 +08:00
11 lines
370 B
ReStructuredText
11 lines
370 B
ReStructuredText
OpenAI Chat Client
|
|
==================
|
|
|
|
Refer to the `trtllm-serve documentation <https://nvidia.github.io/TensorRT-LLM/commands/trtllm-serve.html>`_ for starting a server.
|
|
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/serve/openai_chat_client.py.
|
|
|
|
.. literalinclude:: ../../../examples/serve/openai_chat_client.py
|
|
:language: python
|
|
:linenos:
|