kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-31 08:11:27 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
beefd6413e
TensorRT-LLMs/tests/unittest/_torch/auto_deploy
History
William Zhang c53d1814a7
[None][feat] Extend VLM factory and add Mistral3 factory (#7583) 
This commit:

* extends existing factory interfaces to enable Mistral3 in AutoDeploy.
* adds a Mistral3 VLM factory.
* adds various model patches for pixtral (the vision model) and mistral3
  to make the VLM export compliant.
* adjusts checkpoint loading code to take possible parameter name
  conversions into account.
* fixes a sampling bug (the `end_id` needs to be take into account when
  sampling, but it is not included in the stop words' token IDs).

Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
2025-09-09 02:47:18 -04:00
..
_utils_test [None][feat] Extend VLM factory and add Mistral3 factory (#7583) 2025-09-09 02:47:18 -04:00
unit [None][feat] Extend VLM factory and add Mistral3 factory (#7583) 2025-09-09 02:47:18 -04:00