mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-21 10:15:46 +08:00
9 lines
288 B
ReStructuredText
9 lines
288 B
ReStructuredText
Generate Text Using Lookahead Decoding
|
|
======================================
|
|
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/llm-api/llm_lookahead_decoding.py.
|
|
|
|
.. literalinclude:: ../../../examples/llm-api/llm_lookahead_decoding.py
|
|
:language: python
|
|
:linenos:
|