TensorRT-LLMs/tests/unittest/api_stability/references/guided_decoding_params.yaml
Yixin Dong c90ebadd84
feat: Support the Structural Tag in guided decoding (#4066)
* finish

Signed-off-by: Ubospica <ubospica@gmail.com>

* update

Signed-off-by: Ubospica <ubospica@gmail.com>

* update

Signed-off-by: Ubospica <ubospica@gmail.com>

* fix

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* exc overlap scheduler

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* add test

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

* fix api ref

Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>

---------

Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
Co-authored-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
2025-05-12 17:24:50 +08:00

21 lines
471 B
YAML

methods:
__init__:
parameters:
grammar:
annotation: Optional[str]
default: null
json:
annotation: Union[str, pydantic.main.BaseModel, dict, NoneType]
default: null
json_object:
annotation: bool
default: false
regex:
annotation: Optional[str]
default: null
structural_tag:
annotation: Optional[str]
default: null
return_annotation: None
properties: {}