William Zhang a117e7a57e [TRTLLM-7442][model] Remove unnecessary D2H copies (#7273) ... * Why? Initial profiling showed there were multiple D2H / H2D copies being scheduled in the mistral 3.1 small model. * What? This commit removes those unnecessary copies by returning `image_sizes` as a simple list instead of a tensor. Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>		2025-09-03 23:14:20 -04:00
..
checkpoints	[TRTLLM-6835][fix] Fix potential hang caused by python multiprocessing when prefetching weights (#6927)	2025-09-01 11:02:31 +08:00
__init__.py	[None] [feat] Add Tencent HunYuanMoEV1 model support (#5521)	2025-08-15 06:56:44 +08:00
modeling_auto.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
modeling_bert.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_clip.py	[feat] Enable TP and batching for PixtralVisionModel / Mistral3VLM (#6152)	2025-07-22 11:06:41 -07:00
modeling_deepseekv3.py	[TRTLLM-6747][feat] Merge add sparse exp and shared exp into local reduction (#7369)	2025-08-31 21:20:00 -04:00
modeling_exaone4.py	chore: add EXAONE4 accuracy test (#6397)	2025-08-04 10:14:16 +08:00
modeling_gemma3.py	[TRTLLM-6674][feat] (Breaking Change) Hopper SWA non-cyclic kernels + KV reuse + Spec Dec (#6379)	2025-08-05 07:47:41 +00:00
modeling_gemma3vl.py	[None][chore] Add docs for Gemma3 VLMs (#6880)	2025-09-01 11:02:31 +08:00
modeling_gpt_oss.py	[None][fix] Fix perfect router. (#6797)	2025-08-14 20:09:08 -07:00
modeling_hunyuan_moe.py	[None] [feat] Add Tencent HunYuanMoEV1 model support (#5521)	2025-08-15 06:56:44 +08:00
modeling_hyperclovax.py	[None][fix] Refactoring input prep to allow out-of-tree models (#6497)	2025-08-12 20:29:10 -04:00
modeling_llama_min_latency.py	[Model load] Fix llama min-latency model load (#5883)	2025-07-15 09:29:19 +08:00
modeling_llama.py	[https://nvbugs/5455836][fix] Fix llama 4 FP4 (#6911)	2025-09-01 11:02:31 +08:00
modeling_llava_next.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
modeling_mistral.py	[TRTLLM-7442][model] Remove unnecessary D2H copies (#7273)	2025-09-03 23:14:20 -04:00
modeling_mixtral.py	[None][perf] Improve the performance of online EPLB on Hopper by better overlapping (#6624)	2025-08-12 09:25:13 +08:00
modeling_mllama.py	feat : support duplicate_kv_weight for qwen3 blockwise scale (#5459)	2025-06-30 11:49:22 +08:00
modeling_multimodal_encoder.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_multimodal_utils.py	[TRTLLM-5059][feat] Add KV cache reuse support for multimodal models (#5444)	2025-07-21 16:11:58 -07:00
modeling_nemotron_h.py	[TRTLLM-4921][feat] Enable chunked prefill for Nemotron-H (#6334)	2025-08-22 12:15:20 -04:00
modeling_nemotron_nas.py	[Perf]: Add residual, norm for nemotron_nas models (#6455)	2025-07-30 09:10:38 -07:00
modeling_nemotron.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_phi3.py	[None][fix] Accommodate Phi3/4 to work with ModelOpt's FP8 ckpts in Torch (#6761)	2025-08-19 09:22:46 -07:00
modeling_phi4mm.py	[None][fix] Revert phi4-mm aggregate mode (#6907)	2025-09-01 11:02:31 +08:00
modeling_pixtral.py	[TRTLLM-7442][model] Remove unnecessary D2H copies (#7273)	2025-09-03 23:14:20 -04:00
modeling_qwen2vl.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
modeling_qwen3_moe.py	[None][perf] Improve the performance of online EPLB on Hopper by better overlapping (#6624)	2025-08-12 09:25:13 +08:00
modeling_qwen3.py	[None][feat] Support Yarn on Qwen3 (#6785)	2025-08-17 07:21:29 +08:00
modeling_qwen_moe.py	[None][perf] Improve the performance of online EPLB on Hopper by better overlapping (#6624)	2025-08-12 09:25:13 +08:00
modeling_qwen.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_siglip.py	feat: Update Gemma3 Vision Encoder (#5973)	2025-07-14 22:38:10 +08:00
modeling_speculative.py	[TRTLLM-7028][feat] Enable guided decoding with speculative decoding (part 2: one-model engine) (#6948)	2025-09-03 15:16:11 -07:00
modeling_utils.py	[TRTLLM-7326][feat] Add standalone multimodal encoder (#6743)	2025-08-19 21:42:50 -07:00
modeling_vila.py	[None][fix] Refactoring input prep to allow out-of-tree models (#6497)	2025-08-12 20:29:10 -04:00