mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-21 02:05:17 +08:00
9 lines
322 B
ReStructuredText
9 lines
322 B
ReStructuredText
Distributed LLM Generation
|
|
==========================
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/blob/9ba14263db0045ed3fa0860f949b5ce320107eb3/examples/llm-api/llm_inference_distributed.py.
|
|
|
|
.. literalinclude:: ../../../examples/llm-api/llm_inference_distributed.py
|
|
:lines: 4-44
|
|
:language: python
|
|
:linenos:
|