kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-02-16 07:53:55 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

update tokenizer and processor

Browse Source 
Signed-off-by: Pamela <179191831+pamelap-nvidia@users.noreply.github.com>
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
This commit is contained in:
Pamela 2025-09-08 02:40:17 +00:00 committed by Faraz Khoubsirat
parent 50ba4193f4
commit 1a219f1ed5
No known key found for this signature in database
GPG Key ID: 15733A5323348457
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
tensorrt_llm/_torch/models/modeling_phi4mm.py
View File

@ -404,6 +404,7 @@ class Phi4MMInputProcessor(InputProcessor):
self.tokenizer = tokenizer
self.use_fast = True
model_path = "microsoft/Phi-4-multimodal-instruct"
if self.tokenizer is None:
self.tokenizer = transformers.AutoTokenizer.from_pretrained(
model_path,