TensorRT-LLMs/tensorrt_llm/_torch/models
Yechan Kim 943218b54a
feat: Add Qwen2.5-VL and refactor Qwen2-VL (#3156)
* feat: Add Qwen2.5-VL and refactor Qwen2-VL

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* fix yapf and codespell

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* add test

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* fix test_e2e

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* generalize get_rope_index

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* fix qwen2.5-vl on REAME

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* fix test

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

* fix image test

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>

---------

Signed-off-by: yechank <161688079+yechank-nvidia@users.noreply.github.com>
Co-authored-by: Haohang Huang <31998628+symphonylyh@users.noreply.github.com>
2025-04-10 04:09:03 +08:00
..
__init__.py feat: Add Qwen2.5-VL and refactor Qwen2-VL (#3156) 2025-04-10 04:09:03 +08:00
.gitkeep Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
modeling_auto.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
modeling_bert.py Refactor imports inside tensorrt_llm._torch. (#3015) 2025-03-26 11:01:07 +08:00
modeling_deepseekv3.py Raise error for PP + MTP (#3244) 2025-04-03 04:45:31 +08:00
modeling_llama.py Add Llama 4 (#3302) 2025-04-09 03:35:21 +08:00
modeling_llava_next.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
modeling_mamba_hybrid.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
modeling_mixtral.py feat: Optionally split MoE inputs into chunks to reduce GPU memory usage (#3104) 2025-04-01 16:07:02 +08:00
modeling_mllama.py Add Llama 4 (#3302) 2025-04-09 03:35:21 +08:00
modeling_multimodal_encoder.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
modeling_multimodal_utils.py Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
modeling_nemotron.py Add initial EAGLE-3 implementation (#3035) 2025-03-29 22:31:24 +08:00
modeling_nvsmall.py Fix torch nvsmall through pyexecutor and fix its TP support (#3238) 2025-04-07 11:53:17 +03:00
modeling_qwen2vl.py feat: Add Qwen2.5-VL and refactor Qwen2-VL (#3156) 2025-04-10 04:09:03 +08:00
modeling_qwen.py feat: Add Qwen2.5-VL and refactor Qwen2-VL (#3156) 2025-04-10 04:09:03 +08:00
modeling_utils.py Add Llama 4 (#3302) 2025-04-09 03:35:21 +08:00
modeling_vila.py Add Llama 4 (#3302) 2025-04-09 03:35:21 +08:00