mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-09 12:41:52 +08:00
9 lines
326 B
ReStructuredText
9 lines
326 B
ReStructuredText
Generate text with guided decoding
|
|
==================================
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/blob/2128f73d58508a1a0b37119bd851edb19ab88635/examples/llm-api/llm_guided_decoding.py.
|
|
|
|
.. literalinclude:: ../../../examples/llm-api/llm_guided_decoding.py
|
|
:lines: 4-47
|
|
:language: python
|
|
:linenos:
|