Xuan-Son Nguyen e37abd6b5f mtmd: add batching API (#24384) ...

* mtmd: add batching API

* wip

* first working version (gemma4v)

* add arg

* nits

* wire up support_batch()

* fix 0.0 output embd

* fix audio

* nits

* refactor a bit

* nits

* fix non-batching case

* fix comment

2026-06-13 00:10:29 +02:00

..

cogvlm.cpp

…

conformer.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

deepseekocr2.cpp

mtmd: Add DeepSeekOCR 2 Support (#20975)

2026-05-29 16:13:51 +02:00

deepseekocr.cpp

mtmd: Add DeepSeekOCR 2 Support (#20975)

2026-05-29 16:13:51 +02:00

dotsocr.cpp

…

exaone4_5.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

gemma4a.cpp

…

gemma4ua.cpp

mtmd, model: allow skip build_vit() (#24077)

2026-06-03 17:10:35 +02:00

gemma4uv.cpp

mtmd, model: allow skip build_vit() (#24077)

2026-06-03 17:10:35 +02:00

gemma4v.cpp

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

glm4v.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

granite4-vision.cpp

model, mtmd: Granite4 Vision (#23545)

2026-06-05 17:44:59 +02:00

granite-speech.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

hunyuanvl.cpp

mtmd, model : merge HunyuanOCR into HunyuanVL and fix OCR vision precision (#23329)

2026-05-21 00:35:37 +02:00

internvl.cpp

…

kimik25.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

kimivl.cpp

…

llama4.cpp

…

llava.cpp

model, mtmd: Granite4 Vision (#23545)

2026-06-05 17:44:59 +02:00

mimovl.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

minicpmv.cpp

…

mobilenetv5.cpp

…

models.h

mtmd: add batching API (#24384)

2026-06-13 00:10:29 +02:00

nemotron-v2-vl.cpp

…

paddleocr.cpp

…

pixtral.cpp

…

qwen2vl.cpp

mtmd: support "frame merge" for qwen-vl-based models (#21858)

2026-06-06 21:17:25 +02:00

qwen3a.cpp

mtmd: add chunks and fix preproc for qwen3a (#23073)

2026-05-15 19:32:47 +02:00

qwen3vl.cpp

mtmd: support "frame merge" for qwen-vl-based models (#21858)

2026-06-06 21:17:25 +02:00

siglip.cpp

…

step3vl.cpp

…

whisper-enc.cpp

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

2026-06-06 11:06:51 +02:00

yasa2.cpp

…

youtuvl.cpp

…