mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
9 lines
351 B
ReStructuredText
9 lines
351 B
ReStructuredText
Control generated text using logits processor
|
|
=============================================
|
|
Source https://github.com/NVIDIA/TensorRT-LLM/blob/a761585d9c15b4c1249aaf65a8f90764efa83a3c/examples/llm-api/llm_logits_processor.py.
|
|
|
|
.. literalinclude:: ../../../examples/llm-api/llm_logits_processor.py
|
|
:lines: 4-128
|
|
:language: python
|
|
:linenos:
|