kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-16 07:53:55 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[None][fix] Set continuous_usage_stats default to False to follow OpenAI protocol (#10644)

Browse Source 
Signed-off-by: Dmitry Barsukoff <riZZZhik@gmail.com>
Co-authored-by: Kanghwan <861393+karljang@users.noreply.github.com>
This commit is contained in:
Dmitry Barsukoff 2026-02-04 03:04:54 +03:00 committed by GitHub
parent f9e6045f39
commit 5d522295e9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tensorrt_llm/serve/openai_protocol.py
View File

@ -77,7 +77,7 @@ class OpenAIBaseModel(BaseModel):
class StreamOptions(OpenAIBaseModel):
include_usage: Optional[bool] = True
continuous_usage_stats: Optional[bool] = True
continuous_usage_stats: Optional[bool] = False
class PromptTokensDetails(OpenAIBaseModel):