mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-26 05:32:57 +08:00
83f37614ef
* support return logprob in llmapi Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com> update and add test Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com> stability test Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com> * revert removal of old flag Signed-off-by: Erin Ho <erinh@nvidia.com> Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com> --------- Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com> Signed-off-by: Erin Ho <erinh@nvidia.com>
15 lines
268 B
YAML
15 lines
268 B
YAML
methods:
|
|
__init__:
|
|
parameters: {}
|
|
return_annotation: None
|
|
abort:
|
|
parameters: {}
|
|
return_annotation: None
|
|
aborted:
|
|
parameters: {}
|
|
return_annotation: bool
|
|
clear_logprob_params:
|
|
parameters: {}
|
|
return_annotation: None
|
|
properties: {}
|