William Zhang 34c1e9c341 [None][feat] Skip prefetching consolidated safetensors when appropriate (#7225) ... * Why? Some models (e.g. anything produced by Mistral) can have both sharded safetensors and a consolidated safetensor in the same checkpoint directory. In such cases, prefetching both to memory is a waste of time, and memory. * What? This commit skips over consolidated safetensors when they are not the only safetensor file present in the checkpoint directory. Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>		2025-08-26 09:40:17 -07:00
..
checkpoints	[None][feat] Skip prefetching consolidated safetensors when appropriate (#7225)	2025-08-26 09:40:17 -07:00
__init__.py	[fix] Fix Mistral3VLM weight-loading & enable in pre-merge (#6105)	2025-07-17 11:04:17 -07:00
modeling_auto.py	[feat] Implement model-agnostic one-engine eagle3 (#4778)	2025-06-13 08:11:41 -07:00
modeling_bert.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_clip.py	[feat] Enable TP and batching for PixtralVisionModel / Mistral3VLM (#6152)	2025-07-22 11:06:41 -07:00
modeling_deepseekv3.py	[fix] Fix DeepSeek w4a8 weight loading (#6498)	2025-08-04 10:12:06 +08:00
modeling_exaone4.py	chore: add EXAONE4 accuracy test (#6397)	2025-08-04 10:14:16 +08:00
modeling_gemma3.py	[TRTLLM-6674][feat] (Breaking Change) Hopper SWA non-cyclic kernels + KV reuse + Spec Dec (#6379)	2025-08-05 07:47:41 +00:00
modeling_gemma3vl.py	[None][chore] Add docs for Gemma3 VLMs (#6880)	2025-08-14 18:23:32 -07:00
modeling_hyperclovax.py	fix: support mixture of text & multimodal prompts (#6345)	2025-07-30 08:52:31 +08:00
modeling_llama_min_latency.py	[Model load] Fix llama min-latency model load (#5883)	2025-07-15 09:29:19 +08:00
modeling_llama.py	[https://nvbugs/5427801][fix] Torch compile support for Llama4 and Ea… (#6978)	2025-08-20 15:06:56 +08:00
modeling_llava_next.py	[None][fix] fix log_once usage (#7210)	2025-08-26 19:13:03 +08:00
modeling_mistral.py	[None][fix] Fix batching bug in Mistral3 model (#6841)	2025-08-14 02:15:44 -04:00
modeling_mixtral.py	feat: Remove padding in attention DP. (#6064)	2025-07-18 23:30:34 +08:00
modeling_mllama.py	feat : support duplicate_kv_weight for qwen3 blockwise scale (#5459)	2025-06-30 11:49:22 +08:00
modeling_multimodal_encoder.py	Update TensorRT-LLM (#2873)	2025-03-11 21:13:42 +08:00
modeling_multimodal_utils.py	[TRTLLM-5059][feat] Add KV cache reuse support for multimodal models (#5444)	2025-07-21 16:11:58 -07:00
modeling_nemotron_h.py	[None][fix] Remove expand configuration from mamba2 mixer (#6521)	2025-08-05 04:18:25 -04:00
modeling_nemotron_nas.py	[Perf]: Add residual, norm for nemotron_nas models (#6455)	2025-07-30 09:10:38 -07:00
modeling_nemotron.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_phi3.py	feat: TRTLLM-6450 update long rope for phi3.5/phi4-mini/phi4-mm (#6353)	2025-07-30 09:20:16 -07:00
modeling_phi4mm.py	[TRTLLM-6825][fix] Update lora for phi4-mm (#7149)	2025-08-23 20:57:00 +08:00
modeling_pixtral.py	[feat] Enable TP and batching for PixtralVisionModel / Mistral3VLM (#6152)	2025-07-22 11:06:41 -07:00
modeling_qwen2vl.py	[PERF] Move calculation Qwen2-VL's rotary_cos_sin to LLM worker process (#6004)	2025-07-31 09:35:24 +09:00
modeling_qwen3_moe.py	Qwen3: Fix eagle hidden states (#6199)	2025-08-06 17:05:18 -04:00
modeling_qwen3.py	[https://nvbugs/5461712] [fix] Disable deep_gemm for Qwen3 due to accuracy issues (#7170)	2025-08-23 05:26:12 -04:00
modeling_qwen_moe.py	[TRTLLM-5493] Add core infrastructure to enable loading of custom checkpoint formats (#5372)	2025-07-17 00:50:30 +08:00
modeling_qwen.py	feat: Remove not used padding_idx in models (#5385)	2025-06-25 17:19:59 +08:00
modeling_siglip.py	feat: Update Gemma3 Vision Encoder (#5973)	2025-07-14 22:38:10 +08:00
modeling_speculative.py	[https://nvbugs/5427801][fix] Torch compile support for Llama4 and Ea… (#6978)	2025-08-20 15:06:56 +08:00
modeling_utils.py	[fix] Fix DeepSeek w4a8 weight loading (#6498)	2025-08-04 10:12:06 +08:00
modeling_vila.py	fix: support mixture of text & multimodal prompts (#6345)	2025-07-30 08:52:31 +08:00