vllm/docs/source/design/input_processing/model_inputs_index.md

(input-processing)=

Input Processing

.. currentmodule:: vllm.inputs

Each model can override parts of vLLM's input processing pipeline via {data}~vllm.inputs.INPUT_REGISTRY and {data}~vllm.multimodal.MULTIMODAL_REGISTRY.

Currently, this mechanism is only utilized in multi-modal models for preprocessing multi-modal input data in addition to input prompt, but it can be extended to text-only language models when needed.

Guides

:maxdepth: 1

input_processing_pipeline

Module Contents

LLM Engine Inputs

.. autoclass:: vllm.inputs.DecoderOnlyInputs
    :members:
    :show-inheritance:

Registry

.. autodata:: vllm.inputs.INPUT_REGISTRY

.. automodule:: vllm.inputs.registry
    :members:
    :show-inheritance: