Oğuzhan KIR f25952e59b [MM][Perf][CG] Support ViT full CUDA graph for InternVL (#41759) ...

Signed-off-by: oguz <oguzhankir17@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2026-06-04 10:24:25 +08:00

..

applications

[Examples][last/6] Resettle examples. (#41084)

2026-05-07 19:42:12 -07:00

basic

[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688)

2026-04-24 05:37:50 +00:00

deployment

[Examples][last/6] Resettle examples. (#41084)

2026-05-07 19:42:12 -07:00

disaggregated

[KV Connector] Remove compat support for pre-v0.12.0 constructor signatures without KVCacheConfig (#39832)

2026-05-09 23:39:46 +00:00

features

[Perf] Optimize hidden state extraction logic (#37374)

2026-05-22 18:23:08 -04:00

generate

[MM][Perf][CG] Support ViT full CUDA graph for InternVL (#41759)

2026-06-04 10:24:25 +08:00

observability

[Examples][last/6] Resettle examples. (#41084)

2026-05-07 19:42:12 -07:00

pooling

[Feature] Add instruction support for score/rerank chat templates (#42412)

2026-05-14 09:41:22 +08:00

ray_serving

[Examples] Resettle Disaggregated examples. (#40759)

2026-05-06 01:20:38 -07:00

reasoning

[Examples] Resettle generate examples. (#36464)

2026-04-27 07:48:37 +00:00

rl

[Frontend][Core] Add sparse NCCL weight transfer support for in-place updates (#40096)

2026-06-01 15:37:30 -04:00

speech_to_text

[Examples][last/6] Resettle examples. (#41084)

2026-05-07 19:42:12 -07:00

tool_calling

[Bugfix] Fix broken example opeanai client (#41088)

2026-04-28 04:43:04 +00:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatglm.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatml.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_falcon_180b.jinja

…

template_falcon.jinja

Add chat templates for Falcon (#3420)

2024-03-14 23:19:02 -07:00

template_inkbot.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_teleflm.jinja

[Model] Support Tele-FLM Model (#15023)

2025-03-22 02:04:44 -07:00

tool_chat_template_apertus.jinja

[Model] Add Apertus Tool Parser (#41154)

2026-05-18 11:20:04 -04:00

tool_chat_template_deepseekr1.jinja

…

tool_chat_template_deepseekv3.jinja

[Feature] Support DeepSeekV3 Function Call (#17784)

2025-05-12 00:45:21 -07:00

tool_chat_template_deepseekv31.jinja

Support DeepSeek-V3.1 tool call (#23454)

2025-08-23 05:50:16 +00:00

tool_chat_template_functiongemma.jinja

[Frontend] add FunctionGemma tool parser support (#31218)

2025-12-25 15:29:25 +08:00

tool_chat_template_gemma3_pythonic.jinja

[Misc] Add gemma3 chat template with pythonic-style function calling (#17149)

2025-08-21 21:06:50 -07:00

tool_chat_template_gemma4.jinja

fix(frontend): Add multimodal placeholders to Gemma4 tool message template (#41459)

2026-05-28 14:48:12 -07:00

tool_chat_template_glm4.jinja

…

tool_chat_template_granite_20b_fc.jinja

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)

2024-10-29 15:07:37 -07:00

tool_chat_template_granite.jinja

[ROCm][CI] Stabilize Granite tool-use and test URL construction (#43017)

2026-05-23 12:21:11 +08:00

tool_chat_template_hermes.jinja

[Bugfix] Fix Hermes tool call chat template bug (#8256)

2024-09-07 10:49:01 +08:00

tool_chat_template_hunyuan_a13b.jinja

…

tool_chat_template_internlm2_tool.jinja

[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)

2024-10-04 10:36:39 +08:00

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

[Misc] Update llama 3.2 template to support system prompt with images (#10901)

2024-12-05 05:54:06 +00:00

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_llama4_json.jinja

Add chat template for Llama 4 models (#16428)

2025-04-24 20:19:36 +00:00

tool_chat_template_llama4_pythonic.jinja

…

tool_chat_template_minimax_m1.jinja

[Feature] Support MiniMax-M1 function calls features (#20297)

2025-07-03 06:48:27 +00:00

tool_chat_template_mistral3.jinja

[Bugfix] Fix tool call template validation for Mistral models (#17644)

2025-05-08 09:47:19 +00:00

tool_chat_template_mistral_parallel.jinja

[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)

2024-10-03 03:04:17 +00:00

tool_chat_template_mistral.jinja

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649)

2024-09-04 13:18:13 -07:00

tool_chat_template_phi4_mini.jinja

[Doc]: fixing typos to improve docs (#24480)

2025-09-08 23:06:04 -07:00

tool_chat_template_qwen3coder.jinja

…

tool_chat_template_toolace.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_xlam_llama.jinja

…

tool_chat_template_xlam_qwen.jinja

Add xLAM tool parser support (#17148)

2025-06-19 14:26:41 +08:00