TensorRT-LLMs/_sources/llm-api-examples/llm_logits_processor.rst.txt
2024-11-04 15:10:33 +08:00

9 lines
248 B
ReStructuredText

LLM Logits Processor
====================
Source https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/llm-api/llm_logits_processor.py.
.. literalinclude:: ../../../examples/llm-api/llm_logits_processor.py
:language: python
:linenos: